2024-08-17T02:34:06.710 INFO:root:teuthology version: 1.2.0 2024-08-17T02:34:06.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:34:06.824 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858294' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIRUyjAb3bHqe8b/0af6xI04NHnWASXTaBA1aCZK3tFbEYyb8S4SEhmelapNCIq8ZWPxCmX3T7Dm/X9POhk8LE= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbkvAXuwnmbQARcJAx4s4VX057U3xoGPkenBmmN7ltTQlHwu8BNzl8hXpeMDIS5OLqp878csubghyyMMrzmC7Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:34:06.824 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:34:06.825 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:34:06.825 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:34:06.827 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:34:06.851 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:34:06.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:34:06.851 INFO:teuthology.packaging:ref: None 2024-08-17T02:34:06.851 INFO:teuthology.packaging:tag: None 2024-08-17T02:34:06.851 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:34:06.852 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:34:06.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:34:06.993 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:34:06.994 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:34:07.002 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:34:07.002 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:34:07.010 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:34:07.025 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:34:07.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:34:07.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:28:59.456689', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIRUyjAb3bHqe8b/0af6xI04NHnWASXTaBA1aCZK3tFbEYyb8S4SEhmelapNCIq8ZWPxCmX3T7Dm/X9POhk8LE='} 2024-08-17T02:34:07.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:28:59.458322', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbkvAXuwnmbQARcJAx4s4VX057U3xoGPkenBmmN7ltTQlHwu8BNzl8hXpeMDIS5OLqp878csubghyyMMrzmC7Q='} 2024-08-17T02:34:07.082 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:34:07.089 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:34:07.089 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:34:07.089 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:34:07.149 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fced6787ac0>, signals=[15]) 2024-08-17T02:34:07.150 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:34:07.157 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:34:07.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:34:07.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:34:07.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:34:07.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:34:07.304 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:34:07.310 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-08-17T02:34:07.328 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-08-17T02:34:07.328 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-08-17T02:34:07.385 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:34:07.386 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:34:07.386 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:34:07.386 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:34:07.386 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:34:07.386 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:34:07.386 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-08-17T02:34:07.405 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-08-17T02:34:07.423 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-08-17T02:34:07.424 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-08-17T02:34:07.480 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-08-17T02:34:07.480 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-08-17T02:34:07.480 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-08-17T02:34:07.480 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:34:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:34:07.481 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-08-17T02:34:07.505 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:34:07.514 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:34:07.527 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:34:07.527 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:34:07.530 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:34:07.546 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:34:07.551 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:34:07.551 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:34:07.587 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:34:07.679 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:34:07.733 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:34:07.750 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:34:07.750 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:34:07.750 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:34:07.750 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:34:07.751 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:34:07.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:34:07.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:34:07.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:34:07.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:34:07.919 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:07.919 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:34:07.919 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-08-17T02:34:07.934 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:07.934 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:34:07.934 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-08-17T02:34:07.936 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:34:07.936 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:07.936 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:34:07.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum upgrade -y linux-firmware 2024-08-17T02:34:07.951 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:34:07.951 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:07.951 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:34:07.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum upgrade -y linux-firmware 2024-08-17T02:34:10.224 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:34:10.343 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-17T02:34:12.017 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-08-17T02:34:12.302 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-17T02:34:16.409 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-17T02:34:16.486 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.6 MB 00:00 2024-08-17T02:34:18.019 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 18 kB 00:00 2024-08-17T02:34:18.218 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 18 kB 00:00 2024-08-17T02:34:18.982 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:34:19.172 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:34:24.438 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-17T02:34:24.611 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-17T02:34:26.553 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-08-17T02:34:26.562 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 1 Package 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 383 M 2024-08-17T02:34:26.563 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-08-17T02:34:26.678 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-08-17T02:34:26.685 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-08-17T02:34:26.685 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-08-17T02:34:26.685 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-08-17T02:34:26.685 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 1 Package 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 383 M 2024-08-17T02:34:26.686 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-08-17T02:34:33.696 INFO:teuthology.orchestra.run.smithi161.stdout:linux-firmware-20240716-145.el9.noarch.rpm 55 MB/s | 383 MB 00:06 2024-08-17T02:34:33.696 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:34:33.696 INFO:teuthology.orchestra.run.smithi161.stdout:Total 55 MB/s | 383 MB 00:07 2024-08-17T02:34:36.778 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-08-17T02:34:36.949 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-08-17T02:34:36.949 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-08-17T02:34:40.240 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-08-17T02:34:40.240 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-08-17T02:34:45.945 INFO:teuthology.orchestra.run.smithi149.stdout:linux-firmware-20240716-145.el9.noarch.rpm 20 MB/s | 383 MB 00:19 2024-08-17T02:34:45.946 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:34:45.946 INFO:teuthology.orchestra.run.smithi149.stdout:Total 20 MB/s | 383 MB 00:19 2024-08-17T02:34:49.040 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-08-17T02:34:49.247 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-08-17T02:34:49.279 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-08-17T02:34:49.279 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-08-17T02:34:49.906 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:49.997 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:50.799 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:50.799 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:51.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:51.569 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:34:51.569 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-08-17T02:34:51.569 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:34:51.569 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:34:51.569 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-08-17T02:34:51.895 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:34:51.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:52.049 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:34:52.049 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:34:52.052 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2024-08-17T02:34:52.522 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-08-17T02:34:52.522 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-08-17T02:35:01.464 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-08-17T02:35:02.177 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:35:02.251 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:02.794 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:02.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:35:03.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17 02:35:03 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:35:03.094 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2024-08-17 02:35:03-- 2024-08-17T02:35:03.094 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 11s 2024-08-17T02:35:03.094 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 344M in 11s (32.0 MB/s) 2024-08-17T02:35:03.097 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:35:03.098 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:35:03.532 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:03.532 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:35:03.533 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-08-17T02:35:03.533 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:35:03.533 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:35:03.533 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-08-17T02:35:03.860 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:35:03.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:04.007 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:35:04.007 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:35:04.009 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-08-17T02:35:05.171 INFO:teuthology.orchestra.run.smithi161.stdout:Verifying... ######################################## 2024-08-17T02:35:05.298 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing... ######################################## 2024-08-17T02:35:05.348 INFO:teuthology.orchestra.run.smithi161.stdout:Updating / installing... 2024-08-17T02:35:13.394 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:35:13.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17 02:35:13 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:35:13.414 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2024-08-17 02:35:13-- 2024-08-17T02:35:13.414 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 9.4s 2024-08-17T02:35:13.414 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 344M in 9.1s (37.7 MB/s) 2024-08-17T02:35:13.417 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:35:13.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:35:15.481 INFO:teuthology.orchestra.run.smithi149.stdout:Verifying... ######################################## 2024-08-17T02:35:15.522 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing... ######################################## 2024-08-17T02:35:15.572 INFO:teuthology.orchestra.run.smithi149.stdout:Updating / installing... 2024-08-17T02:35:23.702 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:35:53.108 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:35:53.109 DEBUG:teuthology.orchestra.run.smithi161:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:35:53.187 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:35:53.188 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:35:53.189 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:35:53.190 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:35:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:35:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:35:53.193 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:35:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:35:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:35:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:35:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:35:53.198 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:35:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:35:53.200 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:35:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:35:53.202 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:35:53.203 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:35:53.204 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:35:53.205 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:35:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:35:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:35:53.208 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:35:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:35:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:35:53.211 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:35:53.212 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:35:53.213 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:35:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:35:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:35:53.216 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:35:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:35:53.218 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:35:53.219 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:35:53.220 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:35:53.221 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:35:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:35:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:35:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:35:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:35:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:35:53.227 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:35:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:35:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:35:53.230 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:35:53.231 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:35:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:35:53.233 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:35:53.234 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:35:53.235 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:35:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:35:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:35:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:35:53.239 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:35:53.240 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:35:53.241 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:35:53.242 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:35:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:35:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:35:53.245 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:35:53.246 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:35:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:35:53.248 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:35:53.249 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:35:53.250 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:35:53.251 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:35:53.253 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:35:53.253 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:35:53.253 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:35:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:35:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:35:53.256 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:35:53.257 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:35:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:35:53.259 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:35:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:35:53.261 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:35:53.262 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:35:53.263 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:35:53.264 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:35:53.265 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:35:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:35:53.267 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:35:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:35:53.269 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:35:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:35:53.271 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:35:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:35:53.273 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:35:53.274 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:35:53.275 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:35:53.276 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:35:53.277 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:35:53.278 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:35:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:35:53.280 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:35:53.281 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:35:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:35:53.284 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:35:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:35:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:35:53.287 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:35:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:35:53.289 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:35:53.290 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:35:53.291 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:35:53.292 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:35:53.293 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:35:53.294 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:35:53.295 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:35:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:35:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:35:53.298 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:35:53.299 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:35:53.300 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:35:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:35:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:35:53.303 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:35:53.304 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:35:53.305 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:35:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:35:53.307 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:35:53.308 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:35:53.309 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:35:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:35:53.311 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:35:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:35:53.313 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:35:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:35:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:35:53.316 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:35:53.317 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:35:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:35:53.319 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:35:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:35:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:35:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:35:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:35:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:35:53.325 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:35:53.326 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:35:53.327 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:35:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:35:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:35:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:35:53.331 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:35:53.332 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:35:53.333 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:35:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:53.339 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.339 DEBUG:teuthology.orchestra.run.smithi161:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:53.361 INFO:teuthology.orchestra.run.smithi161.stdout: fi 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:done 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-08-17T02:35:53.363 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 68.el9 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8264254 2024-08-17T02:35:53.439 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:35:53.440 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2024-08-17T02:35:53.441 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:35:53.441 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:35:53.441 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:35:53.442 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:53.442 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:35:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-08-17T02:35:55.527 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:35:55.558 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-08-17T02:35:55.564 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-08-17T02:35:55.580 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.bgz58OnsGG 2024-08-17T02:35:55.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bgz58OnsGG 2024-08-17T02:35:55.645 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.bgz58OnsGG 2024-08-17T02:35:55.782 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.bgz58OnsGG is 6KB 2024-08-17T02:35:55.830 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.bgz58OnsGG 2024-08-17T02:35:55.844 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:35:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:35:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:35:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:35:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:35:55.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:56.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-08-17T02:36:00.959 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:36:00.960 DEBUG:teuthology.orchestra.run.smithi149:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:36:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:36:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:36:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:36:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:36:01.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:36:01.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:36:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:36:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:36:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:36:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:36:01.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:36:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:36:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:36:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:36:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:36:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:36:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:36:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:36:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:36:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:36:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:36:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:36:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:36:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:36:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:36:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:36:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:36:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:36:01.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:36:01.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:36:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:36:01.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:36:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:36:01.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:36:01.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:36:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:36:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:36:01.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:36:01.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:36:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:36:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:36:01.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:36:01.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:36:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:36:01.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:36:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:36:01.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:36:01.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:36:01.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:36:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:36:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:36:01.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:36:01.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:36:01.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:36:01.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:36:01.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:36:01.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:36:01.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:36:01.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:36:01.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:36:01.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:36:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:36:01.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:36:01.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:36:01.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:36:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:36:01.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:36:01.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:36:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:36:01.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:36:01.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:36:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:36:01.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:36:01.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:36:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:36:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:36:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:36:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:36:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:36:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:36:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:36:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:36:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:36:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:36:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:36:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:36:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:36:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:36:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:36:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:36:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:36:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:36:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:36:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:36:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:36:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:36:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:36:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:36:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:36:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:36:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:36:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:36:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:36:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:36:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:36:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:36:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:36:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:36:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:36:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:36:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:36:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:36:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:36:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:36:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:36:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:36:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:36:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:36:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:36:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:36:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:36:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:36:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:36:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:36:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:36:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:36:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:36:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:36:01.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:36:01.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:36:01.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:36:01.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:36:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:36:01.184 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:36:01.185 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:36:01.186 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:36:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:36:01.188 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:36:01.189 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:36:01.190 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:36:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:36:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:36:01.193 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:36:01.194 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:36:01.198 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.198 DEBUG:teuthology.orchestra.run.smithi149:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:36:01.220 INFO:teuthology.orchestra.run.smithi149.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:36:01.220 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:36:01.220 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:36:01.220 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-08-17T02:36:01.220 INFO:teuthology.orchestra.run.smithi149.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:36:01.220 INFO:teuthology.orchestra.run.smithi149.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout: fi 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:done 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-08-17T02:36:01.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 68.el9 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-08-17T02:36:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8264254 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:36:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:36:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:36:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:36:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-08-17T02:36:01.296 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:36:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:36:01.297 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:36:01.297 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:01.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:36:01.832 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-08-17T02:36:03.134 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:36:03.166 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-08-17T02:36:03.168 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-08-17T02:36:03.183 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.B5Dw35vW3g 2024-08-17T02:36:03.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B5Dw35vW3g 2024-08-17T02:36:03.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.B5Dw35vW3g 2024-08-17T02:36:03.385 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.B5Dw35vW3g is 6KB 2024-08-17T02:36:03.436 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.B5Dw35vW3g 2024-08-17T02:36:03.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:36:03.512 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:36:03.512 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:36:03.512 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:36:03.512 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:36:03.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:03.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-08-17T02:36:26.068 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:36:26.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:36:26.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:33.660 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:36:33.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:36:33.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:44.643 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-08-17T02:36:52.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-08-17T02:36:53.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:36:53.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:56.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-08-17T02:37:01.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:37:01.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:04.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-08-17T02:37:08.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:37:08.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:16.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:37:16.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:27.135 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-08-17T02:37:34.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-08-17T02:37:42.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:37:42.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:42.695 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-08-17T02:37:43.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:37:43.227 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:37:43.228 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-08-17T02:37:43.262 INFO:teuthology.orchestra.run.smithi161.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:37:43.262 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:37:43.262 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:37:43.262 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:37:44.263 DEBUG:teuthology.parallel:result is None 2024-08-17T02:37:49.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:37:49.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:52.639 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-08-17T02:38:10.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:38:10.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:38:10.992 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-08-17T02:38:11.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:38:11.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:38:11.620 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-08-17T02:38:11.656 INFO:teuthology.orchestra.run.smithi149.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:38:11.656 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:38:11.656 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:38:11.656 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:38:12.659 DEBUG:teuthology.parallel:result is None 2024-08-17T02:38:12.660 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:38:12.669 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:38:12.669 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:38:12.674 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:38:12.716 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:38:12.724 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:38:12.739 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:38:12.739 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:38:12.751 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:38:12.858 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:38:12.868 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:38:12.869 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:38:12.872 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:38:13.005 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:13.042 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:13.066 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:13.193 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:13.197 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:38:13.206 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:38:13.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:38:13.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:38:13.268 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:38:13.278 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:38:13.278 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:38:13.283 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:38:13.317 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:13.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:13.495 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:13.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:13.629 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:38:13.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:38:13.683 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:13.747 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:13.829 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:13.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:13.964 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:38:13.964 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:38:14.018 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-08-17T02:38:14.023 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-08-17T02:38:14.089 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:38:14.143 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:38:14.562 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:38:14.577 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:38:14.577 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:38:14.595 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:38:14.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-08-17T02:38:14.698 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-08-17T02:38:14.702 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-08-17T02:38:14.798 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-08-17T02:38:14.801 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:38:14.801 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-08-17T02:38:14.842 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-08-17T02:38:14.843 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-08-17T02:38:14.887 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-08-17T02:38:14.888 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:38:14.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:38:14.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:38:14.945 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:38:15.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:38:15.002 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:38:15.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:38:15.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:38:15.117 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:38:15.130 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-17T02:38:15.133 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-17T02:38:15.242 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:38:15.253 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:38:15.254 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi149.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:43:49.726 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-08-17T02:43:49.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:43:49.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:43:49.817 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-08-17T02:43:49.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-08-17T02:43:49.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:43:49.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:43:50.015 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-08-17T02:43:50.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-08-17T02:43:50.122 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:43:50.138 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:43:50.139 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:43:50.140 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:43:50.144 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:43:50.145 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:43:50.201 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:43:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:43:50.230 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:43:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:43:50.281 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-08-17T02:43:50.307 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-08-17T02:43:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-08-17T02:43:50.328 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-08-17T02:43:50.334 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:43:50.359 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:43:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:43:50.387 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:43:50.458 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:43:50.464 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:43:50.464 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-08-17T02:43:50.464 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.464 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.464 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.464 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.485 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:43:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:43:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-08-17T02:43:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:50.493 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:43:50.501 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:43:50.501 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:43:50.501 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:43:50.501 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:43:50.506 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:43:50.507 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:43:50.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:43:50.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:43:51.208 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:15 ago on Sat 17 Aug 2024 02:42:35 AM UTC. 2024-08-17T02:43:51.216 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:16 ago on Sat 17 Aug 2024 02:42:35 AM UTC. 2024-08-17T02:43:51.296 INFO:teuthology.orchestra.run.smithi149.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:43:51.305 INFO:teuthology.orchestra.run.smithi161.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:43:51.338 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-08-17T02:43:51.339 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-08-17T02:43:51.339 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-08-17T02:43:51.346 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-08-17T02:43:51.348 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-08-17T02:43:51.348 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-08-17T02:43:51.408 DEBUG:teuthology.orchestra.run.smithi149:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:43:51.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:of the main distribution, and quality may vary. 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:, 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:and packages are not held to any quality or security level. 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:43:51.668 INFO:teuthology.orchestra.run.smithi149.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:43:51.669 INFO:teuthology.orchestra.run.smithi149.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:43:51.683 INFO:teuthology.orchestra.run.smithi161.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:43:51.683 INFO:teuthology.orchestra.run.smithi161.stderr:of the main distribution, and quality may vary. 2024-08-17T02:43:51.683 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr:, 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr:and packages are not held to any quality or security level. 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:43:51.684 INFO:teuthology.orchestra.run.smithi161.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:43:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:Repository successfully enabled. 2024-08-17T02:43:51.770 INFO:teuthology.orchestra.run.smithi161.stdout:Repository successfully enabled. 2024-08-17T02:43:51.792 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:43:51.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:43:51.814 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:43:51.816 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:43:51.946 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:43:51.946 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:43:51.956 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:43:51.956 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:43:52.074 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:43:52.074 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:43:52.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:43:52.088 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:43:52.089 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:43:52.089 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:43:52.131 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:43:52.131 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:43:52.147 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:43:52.148 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:43:52.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:43:52.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:43:52.308 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:43:52.323 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:43:52.364 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-08-17T02:43:52.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-08-17T02:43:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2024-08-17T02:43:52.382 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2024-08-17T02:43:52.647 INFO:teuthology.orchestra.run.smithi161.stdout:45 files removed 2024-08-17T02:43:52.658 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-08-17T02:43:52.679 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:43:52.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:43:53.383 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 231 kB/s | 77 kB 00:00 2024-08-17T02:43:53.397 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 230 kB/s | 77 kB 00:00 2024-08-17T02:43:53.718 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-08-17T02:43:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-08-17T02:43:54.043 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-08-17T02:43:54.090 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 5.5 kB/s | 1.8 kB 00:00 2024-08-17T02:43:54.269 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:43:54.307 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for el9 owned by ceph 42 kB/s | 7.6 kB 00:00 2024-08-17T02:43:54.990 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-17T02:43:55.385 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.2 MB 00:01 2024-08-17T02:43:57.412 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-17T02:43:58.600 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 20 MB 00:02 2024-08-17T02:44:01.979 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-17T02:44:03.450 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.6 MB 00:00 2024-08-17T02:44:03.738 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 18 kB 00:00 2024-08-17T02:44:04.726 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:44:05.073 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 18 kB 00:00 2024-08-17T02:44:06.072 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:44:11.057 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-08-17T02:44:12.461 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-17T02:44:13.611 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:13.612 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:13.623 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:44:13.624 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:44:13.625 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:44:13.625 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:44:13.627 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:44:13.630 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:44:13.630 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:44:13.691 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:44:13.705 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:44:13.706 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:13.707 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:13.708 INFO:teuthology.orchestra.run.smithi161.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:44:13.709 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:44:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:44:13.711 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:44:13.712 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:44:13.713 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:44:13.714 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:44:13.715 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-08-17T02:44:13.716 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-08-17T02:44:13.716 INFO:teuthology.orchestra.run.smithi161.stdout:Install 121 Packages 2024-08-17T02:44:13.716 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 12 Packages 2024-08-17T02:44:13.716 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:44:13.716 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 206 M 2024-08-17T02:44:13.716 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-08-17T02:44:14.817 INFO:teuthology.orchestra.run.smithi161.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 36 kB/s | 6.5 kB 00:00 2024-08-17T02:44:15.024 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:15.024 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:15.035 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:44:15.035 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:44:15.036 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:44:15.037 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:44:15.039 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:44:15.041 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:44:15.042 INFO:teuthology.orchestra.run.smithi161.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 3.5 MB/s | 813 kB 00:00 2024-08-17T02:44:15.042 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:44:15.102 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:44:15.125 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:15.126 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:44:15.127 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:44:15.128 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:44:15.129 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:44:15.130 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:44:15.131 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:44:15.132 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:44:15.133 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:44:15.134 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout:Install 121 Packages 2024-08-17T02:44:15.135 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 12 Packages 2024-08-17T02:44:15.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:44:15.136 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 206 M 2024-08-17T02:44:15.136 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-08-17T02:44:15.142 INFO:teuthology.orchestra.run.smithi161.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.7 MB/s | 5.0 MB 00:00 2024-08-17T02:44:15.175 INFO:teuthology.orchestra.run.smithi161.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.0 MB/s | 137 kB 00:00 2024-08-17T02:44:15.259 INFO:teuthology.orchestra.run.smithi161.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 2.1 MB 00:00 2024-08-17T02:44:15.402 INFO:teuthology.orchestra.run.smithi161.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 6.2 MB/s | 1.4 MB 00:00 2024-08-17T02:44:15.476 INFO:teuthology.orchestra.run.smithi161.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 3.9 MB 00:00 2024-08-17T02:44:15.913 INFO:teuthology.orchestra.run.smithi149.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2024-08-17T02:44:16.094 INFO:teuthology.orchestra.run.smithi161.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 15 MB/s | 22 MB 00:01 2024-08-17T02:44:16.161 INFO:teuthology.orchestra.run.smithi161.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 382 kB/s | 25 kB 00:00 2024-08-17T02:44:16.205 INFO:teuthology.orchestra.run.smithi149.stdout:(2/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.6 MB/s | 5.0 MB 00:00 2024-08-17T02:44:16.247 INFO:teuthology.orchestra.run.smithi149.stdout:(3/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 2.4 MB/s | 813 kB 00:00 2024-08-17T02:44:16.272 INFO:teuthology.orchestra.run.smithi149.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 2.0 MB/s | 137 kB 00:00 2024-08-17T02:44:16.336 INFO:teuthology.orchestra.run.smithi161.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 17 MB/s | 14 MB 00:00 2024-08-17T02:44:16.347 INFO:teuthology.orchestra.run.smithi149.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 19 MB/s | 1.4 MB 00:00 2024-08-17T02:44:16.386 INFO:teuthology.orchestra.run.smithi161.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 4.3 MB/s | 215 kB 00:00 2024-08-17T02:44:16.589 INFO:teuthology.orchestra.run.smithi149.stdout:(6/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 16 MB/s | 3.9 MB 00:00 2024-08-17T02:44:16.719 INFO:teuthology.orchestra.run.smithi161.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 75 kB/s | 25 kB 00:00 2024-08-17T02:44:16.820 INFO:teuthology.orchestra.run.smithi161.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 6.2 MB/s | 636 kB 00:00 2024-08-17T02:44:16.847 INFO:teuthology.orchestra.run.smithi149.stdout:(7/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 3.5 MB/s | 2.1 MB 00:00 2024-08-17T02:44:16.878 INFO:teuthology.orchestra.run.smithi161.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.7 MB/s | 163 kB 00:00 2024-08-17T02:44:16.954 INFO:teuthology.orchestra.run.smithi161.stdout:(15/133): librados-devel-17.2.7-1375.g2577e813. 1.6 MB/s | 126 kB 00:00 2024-08-17T02:44:17.046 INFO:teuthology.orchestra.run.smithi161.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 4.9 MB/s | 458 kB 00:00 2024-08-17T02:44:17.546 INFO:teuthology.orchestra.run.smithi161.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 9.8 MB/s | 4.9 MB 00:00 2024-08-17T02:44:17.638 INFO:teuthology.orchestra.run.smithi161.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 493 kB/s | 45 kB 00:00 2024-08-17T02:44:17.705 INFO:teuthology.orchestra.run.smithi161.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:44:17.773 INFO:teuthology.orchestra.run.smithi149.stdout:(8/133): ceph-osd-17.2.7-1375.g2577e813.el9.x86 13 MB/s | 15 MB 00:01 2024-08-17T02:44:17.840 INFO:teuthology.orchestra.run.smithi149.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 378 kB/s | 25 kB 00:00 2024-08-17T02:44:17.864 INFO:teuthology.orchestra.run.smithi161.stdout:(20/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 6.2 MB/s | 15 MB 00:02 2024-08-17T02:44:17.889 INFO:teuthology.orchestra.run.smithi161.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 991 kB/s | 182 kB 00:00 2024-08-17T02:44:17.983 INFO:teuthology.orchestra.run.smithi161.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 3.7 MB/s | 344 kB 00:00 2024-08-17T02:44:18.006 INFO:teuthology.orchestra.run.smithi161.stdout:(23/133): python3-rados-17.2.7-1375.g2577e813.e 2.5 MB/s | 369 kB 00:00 2024-08-17T02:44:18.074 INFO:teuthology.orchestra.run.smithi161.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.2 MB/s | 116 kB 00:00 2024-08-17T02:44:18.099 INFO:teuthology.orchestra.run.smithi161.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 893 kB/s | 82 kB 00:00 2024-08-17T02:44:18.499 INFO:teuthology.orchestra.run.smithi161.stdout:(26/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 6.9 MB/s | 2.9 MB 00:00 2024-08-17T02:44:18.857 INFO:teuthology.orchestra.run.smithi149.stdout:(10/133): ceph-common-17.2.7-1375.g2577e813.el9 7.1 MB/s | 22 MB 00:03 2024-08-17T02:44:19.017 INFO:teuthology.orchestra.run.smithi161.stdout:(27/133): ceph-test-17.2.7-1375.g2577e813.el9.x 17 MB/s | 48 MB 00:02 2024-08-17T02:44:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:(11/133): ceph-radosgw-17.2.7-1375.g2577e813.el 6.5 MB/s | 14 MB 00:02 2024-08-17T02:44:19.041 INFO:teuthology.orchestra.run.smithi161.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 45 kB/s | 24 kB 00:00 2024-08-17T02:44:19.057 INFO:teuthology.orchestra.run.smithi149.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.0 MB/s | 215 kB 00:00 2024-08-17T02:44:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:(29/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 170 kB/s | 165 kB 00:00 2024-08-17T02:44:19.091 INFO:teuthology.orchestra.run.smithi161.stdout:(30/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.6 MB/s | 124 kB 00:00 2024-08-17T02:44:19.107 INFO:teuthology.orchestra.run.smithi149.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 333 kB/s | 25 kB 00:00 2024-08-17T02:44:19.142 INFO:teuthology.orchestra.run.smithi161.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.7 MB/s | 240 kB 00:00 2024-08-17T02:44:19.158 INFO:teuthology.orchestra.run.smithi149.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 6.2 MB/s | 636 kB 00:00 2024-08-17T02:44:19.183 INFO:teuthology.orchestra.run.smithi149.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.1 MB/s | 163 kB 00:00 2024-08-17T02:44:19.192 INFO:teuthology.orchestra.run.smithi161.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 959 kB/s | 47 kB 00:00 2024-08-17T02:44:19.208 INFO:teuthology.orchestra.run.smithi149.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:44:19.259 INFO:teuthology.orchestra.run.smithi161.stdout:(33/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 15 MB/s | 3.4 MB 00:00 2024-08-17T02:44:19.283 INFO:teuthology.orchestra.run.smithi149.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 4.5 MB/s | 458 kB 00:00 2024-08-17T02:44:19.284 INFO:teuthology.orchestra.run.smithi161.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 159 kB/s | 15 kB 00:00 2024-08-17T02:44:19.318 INFO:teuthology.orchestra.run.smithi161.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 4.5 MB/s | 269 kB 00:00 2024-08-17T02:44:19.350 INFO:teuthology.orchestra.run.smithi149.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 678 kB/s | 45 kB 00:00 2024-08-17T02:44:19.352 INFO:teuthology.orchestra.run.smithi161.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.2 MB/s | 83 kB 00:00 2024-08-17T02:44:19.385 INFO:teuthology.orchestra.run.smithi161.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 271 kB/s | 18 kB 00:00 2024-08-17T02:44:19.409 INFO:teuthology.orchestra.run.smithi149.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 2.0 MB/s | 120 kB 00:00 2024-08-17T02:44:19.484 INFO:teuthology.orchestra.run.smithi149.stdout:(20/133): librgw2-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 4.9 MB 00:00 2024-08-17T02:44:19.494 INFO:teuthology.orchestra.run.smithi161.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-08-17T02:44:19.526 INFO:teuthology.orchestra.run.smithi149.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 1.5 MB/s | 182 kB 00:00 2024-08-17T02:44:19.560 INFO:teuthology.orchestra.run.smithi149.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 4.8 MB/s | 369 kB 00:00 2024-08-17T02:44:19.586 INFO:teuthology.orchestra.run.smithi161.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-08-17T02:44:19.593 INFO:teuthology.orchestra.run.smithi149.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:44:19.619 INFO:teuthology.orchestra.run.smithi149.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 2.0 MB/s | 116 kB 00:00 2024-08-17T02:44:19.644 INFO:teuthology.orchestra.run.smithi149.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:44:19.644 INFO:teuthology.orchestra.run.smithi161.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-08-17T02:44:19.670 INFO:teuthology.orchestra.run.smithi161.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-08-17T02:44:19.703 INFO:teuthology.orchestra.run.smithi149.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.8 MB/s | 165 kB 00:00 2024-08-17T02:44:19.729 INFO:teuthology.orchestra.run.smithi161.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-17T02:44:19.770 INFO:teuthology.orchestra.run.smithi149.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 20 MB/s | 2.9 MB 00:00 2024-08-17T02:44:19.787 INFO:teuthology.orchestra.run.smithi149.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 293 kB/s | 24 kB 00:00 2024-08-17T02:44:19.796 INFO:teuthology.orchestra.run.smithi161.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-08-17T02:44:19.821 INFO:teuthology.orchestra.run.smithi149.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.4 MB/s | 124 kB 00:00 2024-08-17T02:44:19.822 INFO:teuthology.orchestra.run.smithi161.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-08-17T02:44:19.855 INFO:teuthology.orchestra.run.smithi161.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-17T02:44:19.955 INFO:teuthology.orchestra.run.smithi161.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-08-17T02:44:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-08-17T02:44:20.164 INFO:teuthology.orchestra.run.smithi161.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-08-17T02:44:20.187 INFO:teuthology.orchestra.run.smithi149.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 8.4 MB/s | 3.4 MB 00:00 2024-08-17T02:44:20.256 INFO:teuthology.orchestra.run.smithi161.stdout:(49/133): ceph-mgr-diskprediction-local-17.2.7- 6.2 MB/s | 7.4 MB 00:01 2024-08-17T02:44:20.279 INFO:teuthology.orchestra.run.smithi149.stdout:(31/133): ceph-mgr-diskprediction-local-17.2.7- 16 MB/s | 7.4 MB 00:00 2024-08-17T02:44:20.298 INFO:teuthology.orchestra.run.smithi161.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-08-17T02:44:20.304 INFO:teuthology.orchestra.run.smithi149.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.0 MB/s | 240 kB 00:00 2024-08-17T02:44:20.323 INFO:teuthology.orchestra.run.smithi161.stdout:(51/133): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-08-17T02:44:20.330 INFO:teuthology.orchestra.run.smithi149.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 951 kB/s | 47 kB 00:00 2024-08-17T02:44:20.373 INFO:teuthology.orchestra.run.smithi161.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-08-17T02:44:20.380 INFO:teuthology.orchestra.run.smithi149.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 194 kB/s | 15 kB 00:00 2024-08-17T02:44:20.399 INFO:teuthology.orchestra.run.smithi161.stdout:(53/133): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-08-17T02:44:20.414 INFO:teuthology.orchestra.run.smithi149.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.1 MB/s | 269 kB 00:00 2024-08-17T02:44:20.424 INFO:teuthology.orchestra.run.smithi161.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-08-17T02:44:20.439 INFO:teuthology.orchestra.run.smithi149.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.4 MB/s | 83 kB 00:00 2024-08-17T02:44:20.464 INFO:teuthology.orchestra.run.smithi149.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 361 kB/s | 18 kB 00:00 2024-08-17T02:44:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:(55/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-08-17T02:44:20.526 INFO:teuthology.orchestra.run.smithi161.stdout:(56/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-17T02:44:20.548 INFO:teuthology.orchestra.run.smithi149.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-08-17T02:44:20.598 INFO:teuthology.orchestra.run.smithi149.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-08-17T02:44:20.632 INFO:teuthology.orchestra.run.smithi149.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-08-17T02:44:20.657 INFO:teuthology.orchestra.run.smithi149.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-08-17T02:44:20.666 INFO:teuthology.orchestra.run.smithi161.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-08-17T02:44:20.699 INFO:teuthology.orchestra.run.smithi149.stdout:(42/133): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-08-17T02:44:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-08-17T02:44:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-08-17T02:44:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-17T02:44:20.784 INFO:teuthology.orchestra.run.smithi161.stdout:(61/133): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 35 kB 00:00 2024-08-17T02:44:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-08-17T02:44:20.877 INFO:teuthology.orchestra.run.smithi161.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.2 MB/s | 3.0 MB 00:00 2024-08-17T02:44:21.183 INFO:teuthology.orchestra.run.smithi149.stdout:(43/133): ceph-test-17.2.7-1375.g2577e813.el9.x 14 MB/s | 48 MB 00:03 2024-08-17T02:44:21.233 INFO:teuthology.orchestra.run.smithi149.stdout:(44/133): python3-ply-3.11-14.el9.noarch.rpm 185 kB/s | 106 kB 00:00 2024-08-17T02:44:21.259 INFO:teuthology.orchestra.run.smithi149.stdout:(45/133): python3-pycparser-2.20-6.el9.noarch.r 242 kB/s | 135 kB 00:00 2024-08-17T02:44:21.292 INFO:teuthology.orchestra.run.smithi149.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-17T02:44:21.334 INFO:teuthology.orchestra.run.smithi149.stdout:(47/133): python3-requests-2.25.1-8.el9.noarch. 831 kB/s | 125 kB 00:00 2024-08-17T02:44:21.636 INFO:teuthology.orchestra.run.smithi161.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-08-17T02:44:21.719 INFO:teuthology.orchestra.run.smithi161.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-08-17T02:44:21.861 INFO:teuthology.orchestra.run.smithi161.stdout:(66/133): python3-babel-2.9.1-2.el9.noarch.rpm 6.1 MB/s | 6.0 MB 00:00 2024-08-17T02:44:21.886 INFO:teuthology.orchestra.run.smithi161.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-08-17T02:44:21.917 INFO:teuthology.orchestra.run.smithi149.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-08-17T02:44:21.978 INFO:teuthology.orchestra.run.smithi161.stdout:(68/133): openblas-openmp-0.3.21-2.el9.x86_64.r 4.0 MB/s | 4.7 MB 00:01 2024-08-17T02:44:22.003 INFO:teuthology.orchestra.run.smithi161.stdout:(69/133): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-08-17T02:44:22.029 INFO:teuthology.orchestra.run.smithi161.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-08-17T02:44:22.079 INFO:teuthology.orchestra.run.smithi161.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-08-17T02:44:22.105 INFO:teuthology.orchestra.run.smithi161.stdout:(72/133): python3-markupsafe-1.1.1-12.el9.x86_6 463 kB/s | 35 kB 00:00 2024-08-17T02:44:22.159 INFO:teuthology.orchestra.run.smithi149.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 765 kB/s | 689 kB 00:00 2024-08-17T02:44:22.168 INFO:teuthology.orchestra.run.smithi161.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-08-17T02:44:22.188 INFO:teuthology.orchestra.run.smithi161.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-08-17T02:44:22.214 INFO:teuthology.orchestra.run.smithi161.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:44:22.235 INFO:teuthology.orchestra.run.smithi149.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-08-17T02:44:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-08-17T02:44:22.297 INFO:teuthology.orchestra.run.smithi161.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-08-17T02:44:22.331 INFO:teuthology.orchestra.run.smithi161.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-08-17T02:44:22.357 INFO:teuthology.orchestra.run.smithi161.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-08-17T02:44:22.382 INFO:teuthology.orchestra.run.smithi161.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:44:22.432 INFO:teuthology.orchestra.run.smithi161.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-08-17T02:44:22.516 INFO:teuthology.orchestra.run.smithi161.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-08-17T02:44:22.574 INFO:teuthology.orchestra.run.smithi161.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:44:22.633 INFO:teuthology.orchestra.run.smithi161.stdout:(84/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:44:22.692 INFO:teuthology.orchestra.run.smithi161.stdout:(85/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-08-17T02:44:22.760 INFO:teuthology.orchestra.run.smithi149.stdout:(51/133): flex-2.6.4-9.el9.x86_64.rpm 373 kB/s | 313 kB 00:00 2024-08-17T02:44:22.775 INFO:teuthology.orchestra.run.smithi161.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.6 MB/s | 309 kB 00:00 2024-08-17T02:44:22.785 INFO:teuthology.orchestra.run.smithi149.stdout:(52/133): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-08-17T02:44:22.851 INFO:teuthology.orchestra.run.smithi161.stdout:(87/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-08-17T02:44:22.876 INFO:teuthology.orchestra.run.smithi161.stdout:(88/133): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-08-17T02:44:22.943 INFO:teuthology.orchestra.run.smithi161.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-08-17T02:44:22.968 INFO:teuthology.orchestra.run.smithi161.stdout:(90/133): python3-asyncssh-2.13.2-5.el9.noarch. 8.6 MB/s | 548 kB 00:00 2024-08-17T02:44:22.994 INFO:teuthology.orchestra.run.smithi161.stdout:(91/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:44:23.019 INFO:teuthology.orchestra.run.smithi161.stdout:(92/133): python3-cachetools-4.2.4-1.el9.noarch 645 kB/s | 32 kB 00:00 2024-08-17T02:44:23.044 INFO:teuthology.orchestra.run.smithi161.stdout:(93/133): python3-certifi-2023.05.07-4.el9.noar 282 kB/s | 14 kB 00:00 2024-08-17T02:44:23.078 INFO:teuthology.orchestra.run.smithi161.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-17T02:44:23.111 INFO:teuthology.orchestra.run.smithi161.stdout:(95/133): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-08-17T02:44:23.137 INFO:teuthology.orchestra.run.smithi161.stdout:(96/133): python3-google-auth-2.33.0-1.el9.noar 3.7 MB/s | 220 kB 00:00 2024-08-17T02:44:23.153 INFO:teuthology.orchestra.run.smithi161.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2024-08-17T02:44:23.179 INFO:teuthology.orchestra.run.smithi161.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 701 kB/s | 18 kB 00:00 2024-08-17T02:44:23.204 INFO:teuthology.orchestra.run.smithi161.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 458 kB/s | 23 kB 00:00 2024-08-17T02:44:23.230 INFO:teuthology.orchestra.run.smithi161.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-17T02:44:23.255 INFO:teuthology.orchestra.run.smithi161.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-08-17T02:44:23.277 INFO:teuthology.orchestra.run.smithi149.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-08-17T02:44:23.280 INFO:teuthology.orchestra.run.smithi161.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:44:23.306 INFO:teuthology.orchestra.run.smithi161.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 815 kB/s | 41 kB 00:00 2024-08-17T02:44:23.310 INFO:teuthology.orchestra.run.smithi149.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-08-17T02:44:23.331 INFO:teuthology.orchestra.run.smithi161.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:44:23.356 INFO:teuthology.orchestra.run.smithi161.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:44:23.381 INFO:teuthology.orchestra.run.smithi161.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:44:23.394 INFO:teuthology.orchestra.run.smithi149.stdout:(55/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-08-17T02:44:23.415 INFO:teuthology.orchestra.run.smithi161.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:44:23.440 INFO:teuthology.orchestra.run.smithi161.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-08-17T02:44:23.466 INFO:teuthology.orchestra.run.smithi161.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:44:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-08-17T02:44:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-08-17T02:44:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:44:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:44:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-17T02:44:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:44:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:44:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:44:23.702 INFO:teuthology.orchestra.run.smithi161.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-08-17T02:44:23.736 INFO:teuthology.orchestra.run.smithi161.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:44:23.786 INFO:teuthology.orchestra.run.smithi161.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-17T02:44:23.961 INFO:teuthology.orchestra.run.smithi149.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-08-17T02:44:24.045 INFO:teuthology.orchestra.run.smithi149.stdout:(57/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 209 kB/s | 160 kB 00:00 2024-08-17T02:44:24.053 INFO:teuthology.orchestra.run.smithi161.stdout:(121/133): librbd1-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 2.9 MB 00:00 2024-08-17T02:44:24.170 INFO:teuthology.orchestra.run.smithi161.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 7.1 MB/s | 3.1 MB 00:00 2024-08-17T02:44:24.270 INFO:teuthology.orchestra.run.smithi149.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-08-17T02:44:24.403 INFO:teuthology.orchestra.run.smithi161.stdout:(123/133): NetworkManager-1.48.2-2.el9.x86_64.r 6.6 MB/s | 2.3 MB 00:00 2024-08-17T02:44:24.462 INFO:teuthology.orchestra.run.smithi161.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 703 kB/s | 41 kB 00:00 2024-08-17T02:44:24.521 INFO:teuthology.orchestra.run.smithi161.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 4.1 MB/s | 247 kB 00:00 2024-08-17T02:44:24.588 INFO:teuthology.orchestra.run.smithi161.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 4.3 MB/s | 1.8 MB 00:00 2024-08-17T02:44:24.613 INFO:teuthology.orchestra.run.smithi161.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 399 kB/s | 37 kB 00:00 2024-08-17T02:44:24.654 INFO:teuthology.orchestra.run.smithi149.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-08-17T02:44:24.672 INFO:teuthology.orchestra.run.smithi161.stdout:(128/133): elfutils-libs-0.191-4.el9.x86_64.rpm 4.4 MB/s | 260 kB 00:00 2024-08-17T02:44:24.755 INFO:teuthology.orchestra.run.smithi161.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 1.2 MB/s | 207 kB 00:00 2024-08-17T02:44:24.825 INFO:teuthology.orchestra.run.smithi161.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 8.9 MB/s | 1.4 MB 00:00 2024-08-17T02:44:24.846 INFO:teuthology.orchestra.run.smithi149.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 657 kB/s | 581 kB 00:00 2024-08-17T02:44:24.922 INFO:teuthology.orchestra.run.smithi161.stdout:(131/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-08-17T02:44:24.954 INFO:teuthology.orchestra.run.smithi149.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-08-17T02:44:25.064 INFO:teuthology.orchestra.run.smithi161.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 7.7 MB/s | 2.4 MB 00:00 2024-08-17T02:44:25.438 INFO:teuthology.orchestra.run.smithi149.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 374 kB/s | 292 kB 00:00 2024-08-17T02:44:25.463 INFO:teuthology.orchestra.run.smithi149.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-08-17T02:44:26.113 INFO:teuthology.orchestra.run.smithi149.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 4.1 MB/s | 4.7 MB 00:01 2024-08-17T02:44:26.572 INFO:teuthology.orchestra.run.smithi149.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-17T02:44:26.664 INFO:teuthology.orchestra.run.smithi149.stdout:(66/133): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-08-17T02:44:26.762 INFO:teuthology.orchestra.run.smithi161.stdout:(133/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-08-17T02:44:26.768 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:44:26.768 INFO:teuthology.orchestra.run.smithi161.stdout:Total 16 MB/s | 206 MB 00:13 2024-08-17T02:44:26.964 INFO:teuthology.orchestra.run.smithi149.stdout:(67/133): python3-devel-3.9.18-3.el9.x86_64.rpm 287 kB/s | 244 kB 00:00 2024-08-17T02:44:27.273 INFO:teuthology.orchestra.run.smithi149.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 42 kB/s | 26 kB 00:00 2024-08-17T02:44:27.381 INFO:teuthology.orchestra.run.smithi149.stdout:(69/133): python3-jinja2-2.11.3-6.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-08-17T02:44:27.482 INFO:teuthology.orchestra.run.smithi149.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-08-17T02:44:27.990 INFO:teuthology.orchestra.run.smithi149.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 57 kB/s | 35 kB 00:00 2024-08-17T02:44:28.015 INFO:teuthology.orchestra.run.smithi149.stdout:(72/133): python3-mako-1.1.4-6.el9.noarch.rpm 232 kB/s | 172 kB 00:00 2024-08-17T02:44:28.486 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-08-17T02:44:28.658 INFO:teuthology.orchestra.run.smithi149.stdout:(73/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-08-17T02:44:28.697 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-08-17T02:44:28.697 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-08-17T02:44:28.774 INFO:teuthology.orchestra.run.smithi149.stdout:(74/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 320 kB/s | 250 kB 00:00 2024-08-17T02:44:28.800 INFO:teuthology.orchestra.run.smithi149.stdout:(75/133): python3-oauthlib-3.1.1-5.el9.noarch.r 283 kB/s | 222 kB 00:00 2024-08-17T02:44:29.350 INFO:teuthology.orchestra.run.smithi149.stdout:(76/133): python3-packaging-20.9-5.el9.noarch.r 112 kB/s | 77 kB 00:00 2024-08-17T02:44:29.383 INFO:teuthology.orchestra.run.smithi149.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 69 kB/s | 42 kB 00:00 2024-08-17T02:44:29.550 INFO:teuthology.orchestra.run.smithi149.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 212 kB/s | 159 kB 00:00 2024-08-17T02:44:30.051 INFO:teuthology.orchestra.run.smithi149.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 76 kB/s | 51 kB 00:00 2024-08-17T02:44:30.151 INFO:teuthology.orchestra.run.smithi149.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 348 kB/s | 279 kB 00:00 2024-08-17T02:44:30.209 INFO:teuthology.orchestra.run.smithi149.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 81 kB/s | 54 kB 00:00 2024-08-17T02:44:30.760 INFO:teuthology.orchestra.run.smithi149.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-08-17T02:44:30.798 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-08-17T02:44:30.798 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-08-17T02:44:31.052 INFO:teuthology.orchestra.run.smithi149.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 361 kB/s | 304 kB 00:00 2024-08-17T02:44:31.585 INFO:teuthology.orchestra.run.smithi149.stdout:(84/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:44:31.610 INFO:teuthology.orchestra.run.smithi149.stdout:(85/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 112 kB/s | 96 kB 00:00 2024-08-17T02:44:31.694 INFO:teuthology.orchestra.run.smithi149.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.6 MB/s | 309 kB 00:00 2024-08-17T02:44:31.719 INFO:teuthology.orchestra.run.smithi149.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-17T02:44:31.745 INFO:teuthology.orchestra.run.smithi149.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-17T02:44:31.778 INFO:teuthology.orchestra.run.smithi149.stdout:(89/133): python3-asyncssh-2.13.2-5.el9.noarch. 16 MB/s | 548 kB 00:00 2024-08-17T02:44:31.804 INFO:teuthology.orchestra.run.smithi149.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:44:31.829 INFO:teuthology.orchestra.run.smithi149.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:44:31.854 INFO:teuthology.orchestra.run.smithi149.stdout:(92/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 79 kB/s | 64 kB 00:00 2024-08-17T02:44:31.913 INFO:teuthology.orchestra.run.smithi149.stdout:(93/133): python3-certifi-2023.05.07-4.el9.noar 171 kB/s | 14 kB 00:00 2024-08-17T02:44:32.096 INFO:teuthology.orchestra.run.smithi149.stdout:(94/133): python3-cherrypy-18.6.1-2.el9.noarch. 2.3 MB/s | 358 kB 00:00 2024-08-17T02:44:32.130 INFO:teuthology.orchestra.run.smithi149.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 7.2 MB/s | 220 kB 00:00 2024-08-17T02:44:32.155 INFO:teuthology.orchestra.run.smithi149.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-08-17T02:44:32.180 INFO:teuthology.orchestra.run.smithi149.stdout:(97/133): python3-cheroot-8.6.0-4.el9.noarch.rp 578 kB/s | 172 kB 00:00 2024-08-17T02:44:32.206 INFO:teuthology.orchestra.run.smithi149.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 352 kB/s | 18 kB 00:00 2024-08-17T02:44:32.231 INFO:teuthology.orchestra.run.smithi149.stdout:(99/133): python3-jaraco-functools-3.5.0-2.el9. 783 kB/s | 19 kB 00:00 2024-08-17T02:44:32.256 INFO:teuthology.orchestra.run.smithi149.stdout:(100/133): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-17T02:44:32.321 INFO:teuthology.orchestra.run.smithi149.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 219 kB/s | 20 kB 00:00 2024-08-17T02:44:32.348 INFO:teuthology.orchestra.run.smithi149.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 98 kB/s | 9.0 kB 00:00 2024-08-17T02:44:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 786 kB/s | 41 kB 00:00 2024-08-17T02:44:32.399 INFO:teuthology.orchestra.run.smithi149.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:44:32.424 INFO:teuthology.orchestra.run.smithi149.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:44:32.450 INFO:teuthology.orchestra.run.smithi149.stdout:(106/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 52 kB/s | 45 kB 00:00 2024-08-17T02:44:32.475 INFO:teuthology.orchestra.run.smithi149.stdout:(107/133): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-17T02:44:32.525 INFO:teuthology.orchestra.run.smithi149.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 765 kB/s | 16 kB 00:00 2024-08-17T02:44:32.559 INFO:teuthology.orchestra.run.smithi149.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.8 MB/s | 90 kB 00:00 2024-08-17T02:44:32.576 INFO:teuthology.orchestra.run.smithi149.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-08-17T02:44:32.601 INFO:teuthology.orchestra.run.smithi149.stdout:(111/133): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-08-17T02:44:32.626 INFO:teuthology.orchestra.run.smithi149.stdout:(112/133): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-08-17T02:44:32.652 INFO:teuthology.orchestra.run.smithi149.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-17T02:44:32.677 INFO:teuthology.orchestra.run.smithi149.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-17T02:44:32.710 INFO:teuthology.orchestra.run.smithi149.stdout:(115/133): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-08-17T02:44:32.755 INFO:teuthology.orchestra.run.smithi149.stdout:(116/133): python3-typing-extensions-4.12.2-2.e 738 kB/s | 74 kB 00:00 2024-08-17T02:44:32.786 INFO:teuthology.orchestra.run.smithi149.stdout:(117/133): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-08-17T02:44:32.812 INFO:teuthology.orchestra.run.smithi149.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-08-17T02:44:32.837 INFO:teuthology.orchestra.run.smithi149.stdout:(119/133): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-08-17T02:44:32.871 INFO:teuthology.orchestra.run.smithi149.stdout:(120/133): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-08-17T02:44:32.921 INFO:teuthology.orchestra.run.smithi149.stdout:(121/133): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-17T02:44:33.104 INFO:teuthology.orchestra.run.smithi149.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-08-17T02:44:33.205 INFO:teuthology.orchestra.run.smithi149.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 18 MB/s | 1.8 MB 00:00 2024-08-17T02:44:33.247 INFO:teuthology.orchestra.run.smithi149.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 983 kB/s | 41 kB 00:00 2024-08-17T02:44:33.288 INFO:teuthology.orchestra.run.smithi149.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-08-17T02:44:33.339 INFO:teuthology.orchestra.run.smithi149.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 736 kB/s | 37 kB 00:00 2024-08-17T02:44:33.397 INFO:teuthology.orchestra.run.smithi149.stdout:(127/133): librbd1-17.2.7-1375.g2577e813.el9.x8 5.6 MB/s | 2.9 MB 00:00 2024-08-17T02:44:33.423 INFO:teuthology.orchestra.run.smithi149.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.4 MB/s | 207 kB 00:00 2024-08-17T02:44:33.490 INFO:teuthology.orchestra.run.smithi149.stdout:(129/133): openssl-3.2.2-2.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-08-17T02:44:33.540 INFO:teuthology.orchestra.run.smithi149.stdout:(130/133): librados2-17.2.7-1375.g2577e813.el9. 4.4 MB/s | 3.1 MB 00:00 2024-08-17T02:44:33.632 INFO:teuthology.orchestra.run.smithi149.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-08-17T02:44:33.657 INFO:teuthology.orchestra.run.smithi149.stdout:(132/133): elfutils-libs-0.191-4.el9.x86_64.rpm 1.0 MB/s | 260 kB 00:00 2024-08-17T02:44:33.774 INFO:teuthology.orchestra.run.smithi149.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2024-08-17T02:44:33.778 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:44:33.778 INFO:teuthology.orchestra.run.smithi149.stdout:Total 11 MB/s | 206 MB 00:18 2024-08-17T02:44:35.499 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-08-17T02:44:35.709 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-08-17T02:44:35.709 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-08-17T02:44:36.589 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-08-17T02:44:36.712 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:44:36.761 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:44:36.922 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:44:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:44:37.004 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:44:37.064 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:44:37.395 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:44:37.488 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:37.623 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:37.656 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:37.779 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:37.851 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-08-17T02:44:37.852 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-08-17T02:44:38.259 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:38.290 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:38.395 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:38.474 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:44:38.501 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:38.640 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:38.668 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:38.833 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:39.106 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:44:39.309 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:39.388 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:39.498 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:39.604 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:39.961 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:40.002 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:44:40.046 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:44:40.129 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:44:40.170 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:44:40.205 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:44:40.293 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:44:40.372 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:44:40.408 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:44:40.455 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:44:40.541 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:44:40.586 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:44:40.632 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:44:40.724 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:44:40.890 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:44:40.953 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:44:41.598 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:44:41.703 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:44:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:44:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:44:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:44:41.864 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:44:42.000 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:44:42.189 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:44:42.269 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:44:42.358 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:44:42.398 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:44:42.435 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:44:42.494 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:44:42.546 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:44:42.604 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:44:42.775 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:44:42.828 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:44:42.871 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:44:42.987 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:44:43.029 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:44:43.075 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:44:43.111 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:44:43.148 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:44:43.211 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:44:43.248 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:44:43.283 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:44:43.316 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:44:43.359 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:44:43.392 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:44:43.427 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:44:43.476 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:44:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-08-17T02:44:43.599 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:44:43.657 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:44:43.671 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:44:43.727 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:44:43.796 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:44:43.870 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:44:43.905 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:44:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:44:44.293 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:44:44.388 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:44.524 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:44.541 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:44:44.556 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:44.601 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:44:44.635 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:44:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:44.793 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:44:45.024 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:44:45.057 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:44:45.156 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:44:45.180 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:45.216 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:45.391 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:44:45.426 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:45.542 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:45.579 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:45.725 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:45.961 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:44:45.991 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:44:46.105 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:44:46.185 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:46.263 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:46.845 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:46.886 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:44:46.931 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:44:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:44:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:44:47.092 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:44:47.187 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:44:47.250 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:44:47.309 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:44:47.356 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:44:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:44:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:44:47.525 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:44:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:44:47.776 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:44:47.855 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:44:47.862 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:44:48.207 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:44:48.503 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:44:48.542 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:48.637 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:44:48.657 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:48.685 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:44:48.687 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:44:48.733 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:44:48.777 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:44:48.815 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:44:49.005 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:44:49.049 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:44:49.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:44:49.194 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:44:49.233 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:44:49.269 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:44:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:44:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:44:49.455 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:44:49.625 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:44:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:44:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:44:49.840 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:44:49.888 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:44:49.932 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:44:49.962 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:44:49.999 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:44:50.037 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:44:50.074 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:44:50.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:44:50.142 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:44:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:44:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:44:50.278 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:44:50.337 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:44:50.458 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:44:50.516 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:44:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:51.331 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:51.399 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:44:51.461 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:44:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:44:51.640 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:51.686 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:44:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:44:51.925 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:51.975 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:44:51.976 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:44:52.114 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:52.114 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:44:52.114 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:44:52.115 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:44:52.160 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:52.884 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:44:53.028 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:44:54.625 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:44:54.713 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:44:54.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:44:54.765 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:44:55.080 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:44:55.135 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:55.235 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:55.262 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:44:57.931 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:58.587 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:58.637 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:58.772 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:58.772 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:44:58.772 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:44:58.772 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:44:58.813 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:04.003 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:04.003 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2024-08-17T02:45:04.004 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:04.251 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:04.251 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:45:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:05.715 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:05.773 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:05.774 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:05.774 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:45:05.774 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:05.774 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:05.774 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:05.999 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:06.050 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:06.050 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:06.050 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:45:06.051 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:06.051 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:06.051 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:06.466 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:06.518 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:06.518 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:06.518 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:45:06.518 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:06.518 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:06.518 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:06.650 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:45:06.711 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:45:06.783 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:45:07.012 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:45:07.079 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:45:07.165 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:45:07.274 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:45:07.442 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:45:07.500 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:45:07.527 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:45:07.562 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:45:07.611 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:45:07.637 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:45:08.157 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:08.186 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:08.215 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:45:08.285 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:45:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:09.477 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:09.519 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:10.618 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:10.652 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:10.789 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:10.957 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:45:10.988 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:45:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:11.088 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:11.114 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:11.215 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:45:11.285 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:45:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:11.469 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-08-17T02:45:11.469 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-08-17T02:45:11.469 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-08-17T02:45:11.469 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-08-17T02:45:11.469 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-08-17T02:45:11.470 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-08-17T02:45:11.470 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-08-17T02:45:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:11.676 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:45:11.715 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:12.611 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:45:12.658 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:12.779 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:12.779 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:12.779 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:45:12.780 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:12.780 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:12.780 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:12.834 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:12.884 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:12.884 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:45:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:13.002 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:13.002 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:13.003 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:45:13.003 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:13.003 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:13.003 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:13.188 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:13.247 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:13.247 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:13.247 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:45:13.247 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:13.248 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:13.248 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:13.318 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:13.369 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:13.369 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:13.369 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:45:13.369 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:13.369 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:13.369 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:13.497 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:13.548 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:13.548 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:13.548 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:45:13.548 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:13.549 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:13.549 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:13.955 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:14.008 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:14.008 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:45:14.008 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:14.008 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:14.008 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:14.139 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:45:14.198 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:45:14.263 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:45:14.492 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:45:14.551 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:45:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:45:14.746 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:45:14.910 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:45:14.964 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:45:14.990 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:45:15.026 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:45:15.075 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:45:15.100 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:45:15.888 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:15.916 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:15.946 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:45:16.018 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:45:16.047 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:17.210 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:17.249 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:18.114 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:45:18.155 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:45:18.199 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:45:18.228 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:45:18.262 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:45:18.297 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:45:18.328 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:45:18.347 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:18.359 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:18.375 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:18.432 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:45:18.512 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:18.678 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:45:18.718 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:18.771 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:18.771 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:18.771 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:45:18.772 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:18.772 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:18.772 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:18.827 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:18.855 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:18.981 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:45:19.056 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:45:19.753 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:45:20.001 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:45:20.077 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:45:20.124 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:45:20.236 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:45:20.281 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:45:20.306 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:45:20.331 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:20.385 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:45:20.385 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:20.410 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:45:20.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:20.484 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:20.516 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:45:20.517 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:20.560 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:20.561 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:20.561 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:45:20.561 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:20.561 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:20.561 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:20.606 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:20.627 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:20.651 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:45:20.657 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:20.657 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:20.657 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:45:20.657 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:20.667 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:20.667 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:20.767 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:20.767 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:45:20.767 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:20.767 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:20.920 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:20.920 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:21.030 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:21.063 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:21.090 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:45:21.091 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:21.143 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:21.143 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:21.143 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:45:21.143 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:21.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:21.161 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:21.374 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:21.374 INFO:teuthology.orchestra.run.smithi161.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:45:21.374 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:45:25.911 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:45:25.972 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:45:26.043 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:45:26.086 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:45:26.126 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:45:26.158 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:26.210 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:26.404 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:45:26.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:45:26.406 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:45:26.406 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:45:26.406 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:45:26.406 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:45:26.406 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:45:26.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:45:26.419 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:45:26.420 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:45:26.420 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:45:26.420 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:45:26.420 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:45:26.420 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:45:26.421 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:45:26.422 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:45:26.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:45:26.424 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:45:26.425 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:45:26.426 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:45:26.427 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:26.428 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:45:27.515 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:45:27.792 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:45:27.868 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:45:27.932 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:45:28.048 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:45:28.089 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:45:28.113 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:45:28.139 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:28.167 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:45:28.168 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:45:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:28.402 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:28.402 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:28.402 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-08-17T02:45:28.402 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-08-17T02:45:28.403 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.404 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:45:28.405 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:45:28.406 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:28.407 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:45:28.408 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:45:28.409 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:45:28.410 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:45:28.411 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:45:28.412 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:45:28.413 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:45:28.413 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:28.413 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-08-17T02:45:28.441 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:28.476 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:45:28.502 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:28.503 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:28.882 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:28.912 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:28.948 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:45:29.020 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:29.034 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:29.243 INFO:teuthology.orchestra.run.smithi149.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:45:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:34.463 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:45:34.464 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:45:34.465 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:45:34.465 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:45:34.476 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:45:34.476 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:45:34.476 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:45:34.476 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:45:34.476 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:45:34.477 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:45:34.478 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:45:34.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:45:34.481 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:45:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:45:34.483 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:45:34.484 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:34.485 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:45:36.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:36.454 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:36.454 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:45:36.455 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.456 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:45:36.458 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:45:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:45:36.460 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:45:36.461 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:45:36.462 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:45:36.463 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:36.464 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:45:36.465 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:45:36.465 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:45:36.465 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:45:36.465 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:45:36.465 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:36.465 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-08-17T02:45:37.074 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:37.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:45:37.229 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:45:37.276 INFO:teuthology.orchestra.run.smithi149.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:45:37.277 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:45:37.277 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:45:37.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:45:37.425 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:45:37.476 INFO:teuthology.orchestra.run.smithi161.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:45:37.476 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:45:37.476 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:45:37.479 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:45:37.479 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:37.479 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:45:37.541 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:37.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:45:37.604 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:45:37.604 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:37.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:45:37.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:45:37.758 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:37.758 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:45:37.816 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:45:37.913 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:45:37.913 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:37.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:45:37.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:45:38.066 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:38.066 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:45:38.122 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:45:38.218 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:45:38.219 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:38.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:45:38.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:45:38.372 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:38.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:45:38.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:45:38.524 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:45:38.605 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:45:38.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-08-17T02:45:38.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-08-17T02:45:38.665 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:45:38.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:45:38.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:45:38.723 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:45:38.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:45:38.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:45:38.790 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:45:38.790 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:45:38.790 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:45:38.791 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:38.791 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:45:38.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:38.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:39.055 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:39.055 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:45:39.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:39.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:39.321 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:45:39.321 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:45:39.321 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858294', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIRUyjAb3bHqe8b/0af6xI04NHnWASXTaBA1aCZK3tFbEYyb8S4SEhmelapNCIq8ZWPxCmX3T7Dm/X9POhk8LE=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbkvAXuwnmbQARcJAx4s4VX057U3xoGPkenBmmN7ltTQlHwu8BNzl8hXpeMDIS5OLqp878csubghyyMMrzmC7Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:45:39.322 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:45:39.326 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:45:39.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:45:39.403 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:45:39.460 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:39.460 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:45:39.495 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:45:39.496 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-08-17 02:45:29.623410388 +0000 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-08-17 02:43:04.020795293 +0000 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-08-17 02:43:04.020795293 +0000 2024-08-17T02:45:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-08-17 02:43:04.020795293 +0000 2024-08-17T02:45:39.573 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:45:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-08-17T02:45:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-08-17T02:45:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000338173 s, 1.5 MB/s 2024-08-17T02:45:39.668 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:45:39.705 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-08-17 02:45:29.624410368 +0000 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-08-17 02:43:04.487786042 +0000 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-08-17 02:43:04.487786042 +0000 2024-08-17T02:45:39.782 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-08-17 02:43:04.487786042 +0000 2024-08-17T02:45:39.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:45:39.877 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-08-17T02:45:39.877 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-08-17T02:45:39.877 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000326052 s, 1.6 MB/s 2024-08-17T02:45:39.880 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:45:39.917 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-08-17 02:45:29.625410349 +0000 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-08-17 02:43:04.963776613 +0000 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-08-17 02:43:04.964776593 +0000 2024-08-17T02:45:39.993 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-08-17 02:43:04.963776613 +0000 2024-08-17T02:45:39.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:45:40.086 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-08-17T02:45:40.086 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-08-17T02:45:40.086 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000290844 s, 1.8 MB/s 2024-08-17T02:45:40.088 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:45:40.125 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-08-17 02:45:29.626410328 +0000 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-08-17 02:43:05.432767322 +0000 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-08-17 02:43:05.432767322 +0000 2024-08-17T02:45:40.201 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-08-17 02:43:05.432767322 +0000 2024-08-17T02:45:40.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:45:40.295 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-08-17T02:45:40.295 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-08-17T02:45:40.295 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000498615 s, 1.0 MB/s 2024-08-17T02:45:40.297 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:45:40.334 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:40.334 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:40.334 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:45:40.373 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:45:40.373 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-08-17T02:45:40.450 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:45:40.450 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-08-17 02:45:21.731496478 +0000 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-08-17 02:43:04.030294942 +0000 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-08-17 02:43:04.030294942 +0000 2024-08-17T02:45:40.451 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-08-17 02:43:04.030294942 +0000 2024-08-17T02:45:40.451 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:45:40.544 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-08-17T02:45:40.544 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-08-17T02:45:40.544 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000262574 s, 1.9 MB/s 2024-08-17T02:45:40.547 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:45:40.584 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-08-17T02:45:40.660 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-08-17 02:45:21.731496478 +0000 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-08-17 02:43:04.527284796 +0000 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-08-17 02:43:04.527284796 +0000 2024-08-17T02:45:40.661 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-08-17 02:43:04.527284796 +0000 2024-08-17T02:45:40.661 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:45:40.753 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-08-17T02:45:40.753 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-08-17T02:45:40.753 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000267772 s, 1.9 MB/s 2024-08-17T02:45:40.756 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:45:40.792 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-08-17T02:45:40.867 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:45:40.867 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-08-17 02:45:21.732496458 +0000 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-08-17 02:43:05.015274832 +0000 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-08-17 02:43:05.015274832 +0000 2024-08-17T02:45:40.868 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-08-17 02:43:05.015274832 +0000 2024-08-17T02:45:40.868 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:45:40.959 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-08-17T02:45:40.959 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-08-17T02:45:40.959 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000297274 s, 1.7 MB/s 2024-08-17T02:45:40.962 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:45:40.998 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-08-17T02:45:41.074 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-08-17 02:45:21.732496458 +0000 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-08-17 02:43:05.492265093 +0000 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-08-17 02:43:05.492265093 +0000 2024-08-17T02:45:41.075 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-08-17 02:43:05.492265093 +0000 2024-08-17T02:45:41.075 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:45:41.167 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-08-17T02:45:41.167 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-08-17T02:45:41.167 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000257365 s, 2.0 MB/s 2024-08-17T02:45:41.170 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:45:41.206 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:41.206 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:45:41.206 INFO:tasks.ceph:Generating config... 2024-08-17T02:45:41.208 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:45:41.208 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:45:41.208 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:45:41.208 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:45:41.208 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:45:41.208 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:45:41.208 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:45:41.208 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:45:41.208 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:45:41.208 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:45:41.209 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:45:41.210 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:45:41.210 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:45:41.211 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:45:41.211 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:45:41.211 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:45:41.211 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:45:41.211 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:41.305 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:45:41.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:45:41.389 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:41.445 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.149'), ('mon.b', '172.21.15.161'), ('mon.c', '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]')] 2024-08-17T02:45:41.445 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.149,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:45:41.446 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:41.446 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:45:41.483 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.149 --add b 172.21.15.161 --addv c '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: generated fsid b8d2e793-20e6-428a-8b1c-2d641058b12a 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:setting min_mon_release = octopus 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:epoch 0 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:fsid b8d2e793-20e6-428a-8b1c-2d641058b12a 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:last_changed 2024-08-17T02:45:41.595438+0000 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:created 2024-08-17T02:45:41.595438+0000 2024-08-17T02:45:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:min_mon_release 15 (octopus) 2024-08-17T02:45:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:election_strategy: 1 2024-08-17T02:45:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:0: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.a 2024-08-17T02:45:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2024-08-17T02:45:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:2: [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] mon.c 2024-08-17T02:45:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:45:41.597 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:45:41.633 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b8d2e793-20e6-428a-8b1c-2d641058b12a... 2024-08-17T02:45:41.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:45:41.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:45:41.772 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-08-17T02:45:41.772 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-08-17T02:45:41.772 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:45:41.772 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-08-17T02:45:41.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-08-17T02:45:41.774 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-08-17T02:45:41.775 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = b8d2e793-20e6-428a-8b1c-2d641058b12a 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.776 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-08-17T02:45:41.778 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-08-17T02:45:41.779 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: debug finisher = 20 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-08-17T02:45:41.780 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-08-17T02:45:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-08-17T02:45:41.782 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2024-08-17T02:45:41.783 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-08-17T02:45:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:45:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:45:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.149,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = b8d2e793-20e6-428a-8b1c-2d641058b12a 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-08-17T02:45:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-08-17T02:45:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: debug finisher = 20 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.792 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:45:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-08-17T02:45:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = "" 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-08-17T02:45:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-08-17T02:45:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-08-17T02:45:41.808 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:45:41.808 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:45:41.899 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:45:41.899 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:41.899 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:45:41.934 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:41.934 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:45:42.010 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:45:42.010 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:42.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:45:42.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:42.129 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:45:42.129 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:42.204 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:45:42.205 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:42.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:45:42.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:42.284 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:45:42.284 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:42.359 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:45:42.359 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:45:42.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:45:42.458 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:45:42.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:45:42.571 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:45:42.577 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:45:42.578 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:45:42.677 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:45:42.681 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:45:42.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:45:42.837 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:45:42.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:45:42.897 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:45:42.996 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:45:43.001 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:45:43.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:45:43.155 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:45:43.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:45:43.215 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:45:43.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:45:43.292 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:45:43.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:45:43.395 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:45:43.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:45:43.498 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:45:43.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:45:43.601 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:45:43.628 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:45:43.628 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:45:43.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:43.684 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:43.685 INFO:tasks.ceph:role: osd.0 2024-08-17T02:45:43.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:45:43.685 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:45:43.747 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:43.748 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:44.147 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-08-17T02:45:44.151 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-08-17T02:45:44.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:44.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:44.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:44.398 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:44.398 INFO:tasks.ceph:role: osd.1 2024-08-17T02:45:44.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:45:44.398 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:44.462 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:44.817 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-08-17T02:45:44.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-08-17T02:45:44.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:44.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:44.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:45.031 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:45.031 INFO:tasks.ceph:role: osd.2 2024-08-17T02:45:45.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:45:45.031 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:45:45.097 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:45.097 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:45.097 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:45.098 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:45.475 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-08-17T02:45:45.481 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-08-17T02:45:45.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:45.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:45.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:45.700 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:45.700 INFO:tasks.ceph:role: osd.3 2024-08-17T02:45:45.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:45:45.701 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:45.764 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:45.765 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:45.765 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:45.765 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:46.153 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-08-17T02:45:46.157 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-08-17T02:45:46.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:46.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:46.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:46.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:46.463+0000 7f0c3e11d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:45:46.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:46.466+0000 7f0c3e11d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:45:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:46.466+0000 7f0c3e11d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:45:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:46.466+0000 7f0c3e11d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:45:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:46.466+0000 7f0c3e11d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:45:46.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:46.474+0000 7f0c3e11d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:45:47.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:47.020+0000 7f0c3e11d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:47.792+0000 7f0c3e11d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:48.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:48.563+0000 7f0c3e11d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:49.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:49.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:49.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:49.533+0000 7f93c920c2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:45:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:49.534+0000 7f93c920c2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:45:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:49.534+0000 7f93c920c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:45:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:49.534+0000 7f93c920c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:45:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:49.534+0000 7f93c920c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:45:49.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:49.536+0000 7f93c920c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:50.086+0000 7f93c920c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:50.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:50.851+0000 7f93c920c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:51.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:51.623+0000 7f93c920c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:52.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:52.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:52.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:52.582+0000 7f191288b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:45:52.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:52.583+0000 7f191288b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:45:52.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:52.583+0000 7f191288b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:45:52.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:52.583+0000 7f191288b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:45:52.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:52.583+0000 7f191288b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:45:52.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:52.585+0000 7f191288b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:45:53.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:53.131+0000 7f191288b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:53.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:53.905+0000 7f191288b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:54.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:54.686+0000 7f191288b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:55.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:55.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:55.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:55.650+0000 7f0cf77212c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:45:55.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:55.651+0000 7f0cf77212c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:45:55.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:55.651+0000 7f0cf77212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:55.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:55.651+0000 7f0cf77212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:55.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:55.651+0000 7f0cf77212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:55.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:55.653+0000 7f0cf77212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:45:56.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:56.207+0000 7f0cf77212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:56.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:56.975+0000 7f0cf77212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:57.759 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:45:57.757+0000 7f0cf77212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:58.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:58.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:58.708 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:58.708 INFO:tasks.ceph:role: osd.4 2024-08-17T02:45:58.708 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:45:58.708 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:58.775 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:58.776 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-08-17T02:45:59.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-08-17T02:45:59.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:59.302 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:59.367 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:59.423 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:59.437 INFO:tasks.ceph:role: osd.5 2024-08-17T02:45:59.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:45:59.437 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:45:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:59.501 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:59.502 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:59.860 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-08-17T02:45:59.864 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-08-17T02:45:59.864 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:59.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:46:00.013 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:00.070 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:00.071 INFO:tasks.ceph:role: osd.6 2024-08-17T02:46:00.071 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:46:00.071 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:46:00.133 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:00.134 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:00.528 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-08-17T02:46:00.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-08-17T02:46:00.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:00.630 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:00.693 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:00.749 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:00.750 INFO:tasks.ceph:role: osd.7 2024-08-17T02:46:00.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:46:00.750 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:00.813 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:00.814 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:01.238 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-08-17T02:46:01.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-08-17T02:46:01.242 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:01.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:01.442 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:01.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:01.551+0000 7fb1e72112c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:46:01.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:01.553+0000 7fb1e72112c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:46:01.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:01.553+0000 7fb1e72112c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:46:01.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:01.553+0000 7fb1e72112c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:46:01.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:01.553+0000 7fb1e72112c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:46:01.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:01.561+0000 7fb1e72112c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:46:02.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:02.117+0000 7fb1e72112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:02.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:02.889+0000 7fb1e72112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:03.668+0000 7fb1e72112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:04.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:46:04.572 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:04.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:04.657+0000 7f4c3fd282c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:46:04.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:04.657+0000 7f4c3fd282c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:46:04.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:04.657+0000 7f4c3fd282c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:46:04.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:04.657+0000 7f4c3fd282c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:46:04.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:04.657+0000 7f4c3fd282c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:46:04.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:04.659+0000 7f4c3fd282c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:46:05.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:05.197+0000 7f4c3fd282c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:05.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:05.970+0000 7f4c3fd282c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:06.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:06.737+0000 7f4c3fd282c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:07.596 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:46:07.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:07.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:07.743+0000 7f2845d2f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:46:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:07.744+0000 7f2845d2f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:46:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:07.744+0000 7f2845d2f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:46:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:07.744+0000 7f2845d2f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:46:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:07.744+0000 7f2845d2f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:46:07.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:07.746+0000 7f2845d2f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:46:08.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:08.291+0000 7f2845d2f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:09.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:09.073+0000 7f2845d2f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:09.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:09.327 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:09.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:09.842+0000 7f2845d2f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:10.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:10.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:10.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:10.810+0000 7f6b9d43b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:46:10.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:10.810+0000 7f6b9d43b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:46:10.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:10.810+0000 7f6b9d43b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:46:10.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:10.810+0000 7f6b9d43b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:46:10.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:10.810+0000 7f6b9d43b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:46:10.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:10.812+0000 7f6b9d43b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:46:11.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:11.355+0000 7f6b9d43b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:12.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:12.118+0000 7f6b9d43b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:12.889+0000 7f6b9d43b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:13.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:13.785 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:46:13.786 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:13.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:46:13.849 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:13.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:46:13.948 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:13.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:46:14.043 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:14.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:46:14.139 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:14.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:46:14.234 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:14.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:46:14.330 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:14.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:46:14.427 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.427 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:46:14.485 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:46:14.581 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.581 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:46:14.678 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:46:14.773 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:46:14.870 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.870 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:46:14.966 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:14.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:46:15.061 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:15.062 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:46:15.096 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:15.097 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:46:15.172 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:15.172 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:46:15.207 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:15.208 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:46:15.282 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:46:15.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:46:15.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:46:15.334 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDWDsBmxDNeGxAANJWLu81anA4poe6/LnXAwA== 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDWDsBmFdxlKBAApqflEVQTC/nKsGPvvXCs8A== 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDWDsBmCmTsMRAAgAn6rawlRiQ7eVv56ZMJrg== 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDaDsBmgCSnGxAAyc0cTRYrSZwDsVMlNE6FTA== 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDdDsBmsfXeHxAAYQTtqh0cYFa43CvxnQQoLA== 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDgDsBmB3jaIhAAZPy5LHl68XAJZ+hMhibiKA== 2024-08-17T02:46:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDjDsBmcs/jJhAATXHgCplk4U3GukUEzapRGw== 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDWDsBmdZ8XIhAAWrDpu414FjXJ6jEJAU+gBw== 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDWDsBm1tloOxAAVCWYrCZwPqjbJzet+Z5ocg== 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDXDsBmmZlQCRAAZREbau1SyFint5EmD1uiaA== 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDpDsBmzYvmIBAAPDG91iHyBW/sPTDXSEpkKQ== 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDsDsBmnhE7JxAAUklJBo+4OIQyas3XgJX2iA== 2024-08-17T02:46:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDvDsBmwlJgLBAABnoztGVyL3UsemP0nhWRAg== 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDyDsBmcFRVMBAAkQfBeUkGdxGMa26X7X2Bmg== 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDXDsBme3p7ERAAtoOUldOEC3K9EbCl25U7eQ== 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDXDsBmHmOUFxAA/+lS+DPTrCQSKwcr4DNMzg== 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDXDsBmjMa0HRAAN+YMKYfNt6XY7GwUZwObpg== 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2024-08-17T02:46:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDXDsBmzMbXIxAA+wKTTB8KRorOuuZVcoLbxA== 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDWDsBmxDNeGxAANJWLu81anA4poe6/LnXAwA== 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDWDsBmFdxlKBAApqflEVQTC/nKsGPvvXCs8A== 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDWDsBmCmTsMRAAgAn6rawlRiQ7eVv56ZMJrg== 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDaDsBmgCSnGxAAyc0cTRYrSZwDsVMlNE6FTA== 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDdDsBmsfXeHxAAYQTtqh0cYFa43CvxnQQoLA== 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2024-08-17T02:46:15.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDgDsBmB3jaIhAAZPy5LHl68XAJZ+hMhibiKA== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDjDsBmcs/jJhAATXHgCplk4U3GukUEzapRGw== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDWDsBmdZ8XIhAAWrDpu414FjXJ6jEJAU+gBw== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDWDsBm1tloOxAAVCWYrCZwPqjbJzet+Z5ocg== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDXDsBmmZlQCRAAZREbau1SyFint5EmD1uiaA== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDpDsBmzYvmIBAAPDG91iHyBW/sPTDXSEpkKQ== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDsDsBmnhE7JxAAUklJBo+4OIQyas3XgJX2iA== 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2024-08-17T02:46:15.376 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDvDsBmwlJgLBAABnoztGVyL3UsemP0nhWRAg== 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDyDsBmcFRVMBAAkQfBeUkGdxGMa26X7X2Bmg== 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDXDsBme3p7ERAAtoOUldOEC3K9EbCl25U7eQ== 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout:[client.2] 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDXDsBmHmOUFxAA/+lS+DPTrCQSKwcr4DNMzg== 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDXDsBmjMa0HRAAN+YMKYfNt6XY7GwUZwObpg== 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout:[client.3] 2024-08-17T02:46:15.377 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDXDsBmzMbXIxAA+wKTTB8KRorOuuZVcoLbxA== 2024-08-17T02:46:15.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:15.382 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:15.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:15.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:15.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:15.605 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:15.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.698 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.879 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:15.970 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:16.061 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:16.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:16.152 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:16.243 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:16.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:16.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.341 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.526 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.618 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:16.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.709 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.803 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.897 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.988 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:16.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:17.082 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:46:17.082 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:46:17.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:46:17.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:46:17.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:46:17.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:46:17.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:46:17.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:46:17.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:46:17.664 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:46:17.720 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:17.724 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:17.759 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:46:17.759 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:46:17.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:46:17.799 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:46:17.800 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:46:17.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:46:17.804 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:46:17.804 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:46:17.804 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:46:17.808 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:46:17.808 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:46:17.808 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:46:17.808 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:46:17.812 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:46:17.812 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:46:17.812 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:46:17.815 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:46:17.815 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:46:17.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:46:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.964+0000 7f7cc4a00640 1 Processor -- start 2024-08-17T02:46:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.964+0000 7f7cc4a00640 1 -- start start 2024-08-17T02:46:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.965+0000 7f7cc4a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.965+0000 7f7cc4a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.965+0000 7f7cc4a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc0158400 con 0x7f7cc0155980 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.965+0000 7f7cc4a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00aff40 con 0x7f7cc00af580 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.965+0000 7f7cc4a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01577f0 con 0x7f7cc00a54d0 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbd400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbde00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7cc0155980 0x7f7cc0156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:49572/0 (socket says 172.21.15.149:49572) 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 learned_addr learned my addr 172.21.15.149:0/989026806 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:17.966+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:46:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:46:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:46:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.167+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:46:18.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:18.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:18.568+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:46:19.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.369+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.369+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.369+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.369+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.369+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.370+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.370+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.370+0000 7f7cbd400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.370+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:19.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:19.370+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.965+0000 7f7cb7400640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 msgr2=0x7f7cc0155d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.965+0000 7f7cb7400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc00a54d0 0x7f7cc0155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.965+0000 7f7cb7400640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 msgr2=0x7f7cc00afa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.965+0000 7f7cb7400640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.149:3300/0 conn(0x7f7cc00af580 0x7f7cc00afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.965+0000 7f7cb7400640 1 -- 172.21.15.149:0/989026806 >> v1:172.21.15.161:6789/0 conn(0x7f7cc0155980 legacy=0x7f7cc0156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.965+0000 7f7cb7400640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cb7400640 1 -- 172.21.15.149:0/989026806 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc0157ad0 con 0x7f7ca0006140 2024-08-17T02:46:20.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cb7400640 1 -- 172.21.15.149:0/989026806 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00aff40 con 0x7f7ca00036a0 2024-08-17T02:46:20.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:20.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:20.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:20.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:20.966+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:46:21.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.167+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.167+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:21.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.167+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:21.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.167+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:21.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.167+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:46:21.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.568+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.568+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:21.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.568+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:21.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.568+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:21.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:21.569+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:46:22.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:22.370+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:22.370+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:46:22.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:22.370+0000 7f7cbde00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:22.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:22.370+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:22.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:22.370+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:46:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.181+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755518165 0 0) 0x7f7cc0157ad0 con 0x7f7ca0006140 2024-08-17T02:46:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.181+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca40034e0 con 0x7f7ca0006140 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882962290 0 0) 0x7f7ca40034e0 con 0x7f7ca0006140 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 msgr2=0x7f7ca0005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 --2- 172.21.15.149:0/989026806 >> v2:172.21.15.161:3300/0 conn(0x7f7ca00036a0 0x7f7ca0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca000aeb0 con 0x7f7ca0006140 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f7cac012200 con 0x7f7ca0006140 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 >> v1:172.21.15.149:6789/0 conn(0x7f7ca0006140 legacy=0x7f7ca00085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 reap_dead start 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4003a20 0x7f7ca4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4004780 0x7f7ca4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4005330 0x7f7ca400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00aff40 con 0x7f7ca4005330 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400c260 con 0x7f7ca4003a20 2024-08-17T02:46:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.182+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400c420 con 0x7f7ca4004780 2024-08-17T02:46:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4003a20 0x7f7ca4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4005330 0x7f7ca400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbd400640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4004780 0x7f7ca4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4004780 msgr2=0x7f7ca4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4004780 0x7f7ca4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4003a20 msgr2=0x7f7ca4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4003a20 0x7f7ca4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbe800640 1 -- 172.21.15.149:0/989026806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40034e0 con 0x7f7ca4005330 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.183+0000 7f7cbde00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4003a20 0x7f7ca4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.185+0000 7f7cbe800640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4005330 0x7f7ca400b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00cb8e0 tx=0x7f7cb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e9edb92c47cb4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.185+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb802ad00 con 0x7f7ca4005330 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.185+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb802e070 con 0x7f7ca4005330 2024-08-17T02:46:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.185+0000 7f7cbca00640 1 -- 172.21.15.149:0/989026806 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8034650 con 0x7f7ca4005330 2024-08-17T02:46:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 -- 172.21.15.149:0/989026806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4005330 msgr2=0x7f7ca400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4005330 0x7f7ca400b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00cb8e0 tx=0x7f7cb800b040 comp rx=0 tx=0).stop 2024-08-17T02:46:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 -- 172.21.15.149:0/989026806 shutdown_connections 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4005330 0x7f7ca400b9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4004780 0x7f7ca4004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/989026806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4003a20 0x7f7ca4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 -- 172.21.15.149:0/989026806 >> 172.21.15.149:0/989026806 conn(0x7f7cc0067750 msgr2=0x7f7cc00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 -- 172.21.15.149:0/989026806 shutdown_connections 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.186+0000 7f7cc4a00640 1 -- 172.21.15.149:0/989026806 wait complete. 2024-08-17T02:46:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.188+0000 7f7cc4a00640 1 Processor -- start 2024-08-17T02:46:23.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.188+0000 7f7cc4a00640 1 -- start start 2024-08-17T02:46:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.189+0000 7f7cc4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 0x7f7cc014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.189+0000 7f7cc4a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4004780 0x7f7cc00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cc4a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4005330 0x7f7cc00a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cc4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01658e0 con 0x7f7ca4003a20 2024-08-17T02:46:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cc4a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc015a2d0 con 0x7f7ca4004780 2024-08-17T02:46:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cc4a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00a6490 con 0x7f7ca4005330 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 0x7f7cc014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbd400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4004780 0x7f7cc00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 0x7f7cc014d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:54408/0 (socket says 172.21.15.149:54408) 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 -- 172.21.15.149:0/1875875692 learned_addr learned my addr 172.21.15.149:0/1875875692 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbe800640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4005330 0x7f7cc00a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 -- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4005330 msgr2=0x7f7cc00a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4005330 0x7f7cc00a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 -- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4004780 msgr2=0x7f7cc00a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4004780 0x7f7cc00a5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbde00640 1 -- 172.21.15.149:0/1875875692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00a6770 con 0x7f7ca4003a20 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.190+0000 7f7cbe800640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4005330 0x7f7cc00a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.191+0000 7f7cbde00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 0x7f7cc014d560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0007a40 tx=0x7f7cb0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.191+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0005330 con 0x7f7ca4003a20 2024-08-17T02:46:23.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.191+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0005490 con 0x7f7ca4003a20 2024-08-17T02:46:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.191+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0005640 con 0x7f7ca4003a20 2024-08-17T02:46:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.191+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc0165570 con 0x7f7ca4003a20 2024-08-17T02:46:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.191+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc0165220 con 0x7f7ca4003a20 2024-08-17T02:46:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.192+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7cb001e020 con 0x7f7ca4003a20 2024-08-17T02:46:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.192+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7cb0015a20 con 0x7f7ca4003a20 2024-08-17T02:46:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.193+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc00a6900 con 0x7f7ca4003a20 2024-08-17T02:46:23.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.196+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7cb0026060 con 0x7f7ca4003a20 2024-08-17T02:46:23.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.301+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7cc0071050 con 0x7f7ca4003a20 2024-08-17T02:46:23.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.309+0000 7f7cb5600640 1 -- 172.21.15.149:0/1875875692 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7cb002f020 con 0x7f7ca4003a20 2024-08-17T02:46:23.310 INFO:teuthology.orchestra.run.smithi149.stderr:adjusted tunables profile to default 2024-08-17T02:46:23.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.310+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 msgr2=0x7f7cc014d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.310+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 0x7f7cc014d560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0007a40 tx=0x7f7cb0009040 comp rx=0 tx=0).stop 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 shutdown_connections 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca4005330 0x7f7cc00a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4004780 0x7f7cc00a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 --2- 172.21.15.149:0/1875875692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca4003a20 0x7f7cc014d560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 >> 172.21.15.149:0/1875875692 conn(0x7f7cc0067750 msgr2=0x7f7cc0150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 shutdown_connections 2024-08-17T02:46:23.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:23.311+0000 7f7cc4a00640 1 -- 172.21.15.149:0/1875875692 wait complete. 2024-08-17T02:46:23.315 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:23.315+0000 7fbed3f67ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:46:23.328 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:46:23.328 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:23.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:46:23.354 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:23.354+0000 7f76dbd66ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:46:23.384 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:23.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:46:23.465 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:23.464+0000 7fbed3f67ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:23.481 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:23.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:46:23.509 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:23.508+0000 7f76dbd66ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:23.524 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:23.523+0000 7fbed3f67ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:46:23.566 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-08-17T02:46:23.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:46:23.573 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:23.572+0000 7f76dbd66ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:46:23.628 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:23.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:46:23.694 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:23.694 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:46:23.793 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:23.793 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:46:23.827 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:23.827+0000 7fbed3f67ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:46:23.870 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:23.870+0000 7f76dbd66ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:46:23.884 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:23.883+0000 7fbed3f67ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:46:23.885 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-08-17T02:46:23.885 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:46:23.921 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:23.920+0000 7f76dbd66ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:46:23.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new baab8951-ed5e-48c1-8d54-07426cf7be1e 0 2024-08-17T02:46:24.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.167+0000 7f77b6200640 1 Processor -- start 2024-08-17T02:46:24.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.167+0000 7f77b6200640 1 -- start start 2024-08-17T02:46:24.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.168+0000 7f77b6200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.168+0000 7f77b6200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b006f240 con 0x7f77b0158ea0 2024-08-17T02:46:24.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.168+0000 7f77b6200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00cf410 con 0x7f77b00ca2f0 2024-08-17T02:46:24.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.168+0000 7f77b6200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00c6f20 con 0x7f77b00ca770 2024-08-17T02:46:24.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77a6a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f77b00ca2f0 0x7f77b00c7370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44120/0 (socket says 172.21.15.161:44120) 2024-08-17T02:46:24.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77a6a00640 1 -- 172.21.15.161:0/3828076818 learned_addr learned my addr 172.21.15.161:0/3828076818 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-08-17T02:46:24.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77afe00640 1 --2- 172.21.15.161:0/3828076818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77aea00640 1 -- 172.21.15.161:0/3828076818 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571995540 0 0) 0x7f77b00cf410 con 0x7f77b00ca2f0 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77aea00640 1 -- 172.21.15.161:0/3828076818 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77940034e0 con 0x7f77b00ca2f0 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77aea00640 1 -- 172.21.15.161:0/3828076818 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132912463 0 0) 0x7f77b006f240 con 0x7f77b0158ea0 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77afe00640 1 -- 172.21.15.161:0/3828076818 >> v1:172.21.15.161:6789/0 conn(0x7f77b00ca2f0 legacy=0x7f77b00c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77afe00640 1 -- 172.21.15.161:0/3828076818 >> v1:172.21.15.149:6789/0 conn(0x7f77b0158ea0 legacy=0x7f77b00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.169+0000 7f77afe00640 1 -- 172.21.15.161:0/3828076818 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00d0b70 con 0x7f77b00ca770 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.170+0000 7f77afe00640 1 --2- 172.21.15.161:0/3828076818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00c7a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009e90 tx=0x7f77a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1680989dcf455068 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.170+0000 7f77aea00640 1 -- 172.21.15.161:0/3828076818 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8007550 con 0x7f77b00ca770 2024-08-17T02:46:24.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.170+0000 7f77aea00640 1 -- 172.21.15.161:0/3828076818 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a802d050 con 0x7f77b00ca770 2024-08-17T02:46:24.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.170+0000 7f77aea00640 1 -- 172.21.15.161:0/3828076818 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80078e0 con 0x7f77b00ca770 2024-08-17T02:46:24.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 -- 172.21.15.161:0/3828076818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 msgr2=0x7f77b00c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 --2- 172.21.15.161:0/3828076818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00c7a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009e90 tx=0x7f77a8009780 comp rx=0 tx=0).stop 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 -- 172.21.15.161:0/3828076818 shutdown_connections 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 --2- 172.21.15.161:0/3828076818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00c7a80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 -- 172.21.15.161:0/3828076818 >> 172.21.15.161:0/3828076818 conn(0x7f77b006eb90 msgr2=0x7f77b00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 -- 172.21.15.161:0/3828076818 shutdown_connections 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.171+0000 7f77b6200640 1 -- 172.21.15.161:0/3828076818 wait complete. 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.173+0000 7f77b6200640 1 Processor -- start 2024-08-17T02:46:24.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.173+0000 7f77b6200640 1 -- start start 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77b6200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b00ca2f0 0x7f77b00b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77b6200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77b6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b0158ea0 0x7f77b0159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77b6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b009a760 con 0x7f77b0158ea0 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77b6200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b3690 con 0x7f77b00ca2f0 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77b6200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b38f0 con 0x7f77b00ca770 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:42500/0 (socket says 172.21.15.161:42500) 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 -- 172.21.15.161:0/253720339 learned_addr learned my addr 172.21.15.161:0/253720339 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77afe00640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b0158ea0 0x7f77b0159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77af400640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b00ca2f0 0x7f77b00b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 -- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b00ca2f0 msgr2=0x7f77b00b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b00ca2f0 0x7f77b00b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 -- 172.21.15.161:0/253720339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b0158ea0 msgr2=0x7f77b0159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b0158ea0 0x7f77b0159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.174+0000 7f77a6a00640 1 -- 172.21.15.161:0/253720339 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009a20 con 0x7f77b00ca770 2024-08-17T02:46:24.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.175+0000 7f77a6a00640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00b4660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f779800c4b0 tx=0x7f7798007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.175+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798005aa0 con 0x7f77b00ca770 2024-08-17T02:46:24.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.175+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798005c00 con 0x7f77b00ca770 2024-08-17T02:46:24.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.175+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980070d0 con 0x7f77b00ca770 2024-08-17T02:46:24.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.175+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00b3e80 con 0x7f77b00ca770 2024-08-17T02:46:24.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.175+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b00b59f0 con 0x7f77b00ca770 2024-08-17T02:46:24.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.176+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b0071050 con 0x7f77b00ca770 2024-08-17T02:46:24.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.178+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f77980074c0 con 0x7f77b00ca770 2024-08-17T02:46:24.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.178+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f779801cda0 con 0x7f77b00ca770 2024-08-17T02:46:24.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.180+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7798017070 con 0x7f77b00ca770 2024-08-17T02:46:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.252+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "baab8951-ed5e-48c1-8d54-07426cf7be1e", "id": 0} v 0) v1 -- 0x7f77b00cf600 con 0x7f77b00ca770 2024-08-17T02:46:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.260+0000 7f77a7400640 1 -- 172.21.15.161:0/253720339 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "baab8951-ed5e-48c1-8d54-07426cf7be1e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f779801c440 con 0x7f77b00ca770 2024-08-17T02:46:24.260 INFO:teuthology.orchestra.run.smithi161.stdout:0 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 msgr2=0x7f77b00b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00b4660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f779800c4b0 tx=0x7f7798007d60 comp rx=0 tx=0).stop 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 shutdown_connections 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b0158ea0 0x7f77b0159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b00ca770 0x7f77b00b4660 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 --2- 172.21.15.161:0/253720339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b00ca2f0 0x7f77b00b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 >> 172.21.15.161:0/253720339 conn(0x7f77b006eb90 msgr2=0x7f77b00674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 shutdown_connections 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.261+0000 7f77b6200640 1 -- 172.21.15.161:0/253720339 wait complete. 2024-08-17T02:46:24.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new bf25ee9e-c4ab-404e-8523-087333cdb962 1 2024-08-17T02:46:24.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.423+0000 7f5ec9200640 1 Processor -- start 2024-08-17T02:46:24.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.424+0000 7f5ec9200640 1 -- start start 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec9200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5ec4158ea0 0x7f5ec40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec9200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ec40d09a0 0x7f5ec40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec9200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec406f240 con 0x7f5ec40ca830 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec9200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40c6f20 con 0x7f5ec4158ea0 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec9200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40cf410 con 0x7f5ec40d09a0 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ec40d09a0 0x7f5ec40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ec40d09a0 0x7f5ec40ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46228/0 (socket says 172.21.15.161:46228) 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 -- 172.21.15.161:0/2062098384 learned_addr learned my addr 172.21.15.161:0/2062098384 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:24.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1e00640 1 --2- 172.21.15.161:0/2062098384 >> v2:172.21.15.149:3300/0 conn(0x7f5ec4158ea0 0x7f5ec40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 -- 172.21.15.161:0/2062098384 >> v2:172.21.15.149:3300/0 conn(0x7f5ec4158ea0 msgr2=0x7f5ec40d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 --2- 172.21.15.161:0/2062098384 >> v2:172.21.15.149:3300/0 conn(0x7f5ec4158ea0 0x7f5ec40d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 -- 172.21.15.161:0/2062098384 >> v1:172.21.15.149:6789/0 conn(0x7f5ec40ca830 legacy=0x7f5ec40cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.425+0000 7f5ec1400640 1 -- 172.21.15.161:0/2062098384 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40cac40 con 0x7f5ec40d09a0 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.426+0000 7f5ec1400640 1 --2- 172.21.15.161:0/2062098384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40ca2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ec409dc60 tx=0x7f5eb00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f66cf8bd0257f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec0a00640 1 -- 172.21.15.161:0/2062098384 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb002adf0 con 0x7f5ec40d09a0 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec0a00640 1 -- 172.21.15.161:0/2062098384 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0032440 con 0x7f5ec40d09a0 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec0a00640 1 -- 172.21.15.161:0/2062098384 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0032820 con 0x7f5ec40d09a0 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 -- 172.21.15.161:0/2062098384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec40d09a0 msgr2=0x7f5ec40ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 --2- 172.21.15.161:0/2062098384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40ca2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ec409dc60 tx=0x7f5eb00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 -- 172.21.15.161:0/2062098384 shutdown_connections 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 --2- 172.21.15.161:0/2062098384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40ca2f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 --2- 172.21.15.161:0/2062098384 >> v2:172.21.15.149:3300/0 conn(0x7f5ec4158ea0 0x7f5ec40d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 -- 172.21.15.161:0/2062098384 >> 172.21.15.161:0/2062098384 conn(0x7f5ec406eb90 msgr2=0x7f5ec40cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 -- 172.21.15.161:0/2062098384 shutdown_connections 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.427+0000 7f5ec9200640 1 -- 172.21.15.161:0/2062098384 wait complete. 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.429+0000 7f5ec9200640 1 Processor -- start 2024-08-17T02:46:24.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.429+0000 7f5ec9200640 1 -- start start 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ec40ca830 0x7f5ec4099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec4158ea0 0x7f5ec40c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40691e0 con 0x7f5ec40d09a0 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec9200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec409c490 con 0x7f5ec4158ea0 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec9200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec409b8c0 con 0x7f5ec40ca830 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ec40ca830 0x7f5ec4099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec2800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec4158ea0 0x7f5ec40c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ec40ca830 0x7f5ec4099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:42516/0 (socket says 172.21.15.161:42516) 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1e00640 1 -- 172.21.15.161:0/1231284210 learned_addr learned my addr 172.21.15.161:0/1231284210 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1400640 1 -- 172.21.15.161:0/1231284210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ec40ca830 msgr2=0x7f5ec4099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1400640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ec40ca830 0x7f5ec4099ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1400640 1 -- 172.21.15.161:0/1231284210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec4158ea0 msgr2=0x7f5ec40c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1400640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec4158ea0 0x7f5ec40c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.430+0000 7f5ec1400640 1 -- 172.21.15.161:0/1231284210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0009450 con 0x7f5ec40d09a0 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5ec1400640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40c5f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0031000 tx=0x7f5eb0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0031a60 con 0x7f5ec40d09a0 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0031be0 con 0x7f5ec40d09a0 2024-08-17T02:46:24.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb003d420 con 0x7f5ec40d09a0 2024-08-17T02:46:24.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec409bb60 con 0x7f5ec40d09a0 2024-08-17T02:46:24.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec409c120 con 0x7f5ec40d09a0 2024-08-17T02:46:24.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.431+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5eb0039040 con 0x7f5ec40d09a0 2024-08-17T02:46:24.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.432+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f5eb0046450 con 0x7f5ec40d09a0 2024-08-17T02:46:24.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.432+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec4071050 con 0x7f5ec40d09a0 2024-08-17T02:46:24.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.435+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5eb0037070 con 0x7f5ec40d09a0 2024-08-17T02:46:24.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.510+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf25ee9e-c4ab-404e-8523-087333cdb962", "id": 1} v 0) v1 -- 0x7f5ec409c5d0 con 0x7f5ec40d09a0 2024-08-17T02:46:24.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.517+0000 7f5eb9600640 1 -- 172.21.15.161:0/1231284210 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf25ee9e-c4ab-404e-8523-087333cdb962", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5eb003dc20 con 0x7f5ec40d09a0 2024-08-17T02:46:24.518 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-08-17T02:46:24.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ec40d09a0 msgr2=0x7f5ec40c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40c5f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0031000 tx=0x7f5eb0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:24.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 shutdown_connections 2024-08-17T02:46:24.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ec4158ea0 0x7f5ec40c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ec40d09a0 0x7f5ec40c5f70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 --2- 172.21.15.161:0/1231284210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ec40ca830 0x7f5ec4099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 >> 172.21.15.161:0/1231284210 conn(0x7f5ec406eb90 msgr2=0x7f5ec40c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.518+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 shutdown_connections 2024-08-17T02:46:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.519+0000 7f5ec9200640 1 -- 172.21.15.161:0/1231284210 wait complete. 2024-08-17T02:46:24.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new b2ddc120-00a5-4eee-a5df-5feefc75e7b8 2 2024-08-17T02:46:24.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.678+0000 7fde4cc00640 1 Processor -- start 2024-08-17T02:46:24.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.678+0000 7fde4cc00640 1 -- start start 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.679+0000 7fde4cc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde48158ea0 0x7fde480d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.679+0000 7fde4cc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde4cc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4806f240 con 0x7fde480d09a0 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde4cc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde480c6f20 con 0x7fde48158ea0 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde4cc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480cf410 con 0x7fde480caa00 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde46800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde46800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:42532/0 (socket says 172.21.15.161:42532) 2024-08-17T02:46:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde46800640 1 -- 172.21.15.161:0/2374158171 learned_addr learned my addr 172.21.15.161:0/2374158171 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde45e00640 1 --2- 172.21.15.161:0/2374158171 >> v2:172.21.15.149:3300/0 conn(0x7fde48158ea0 0x7fde480d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde46800640 1 -- 172.21.15.161:0/2374158171 >> v2:172.21.15.149:3300/0 conn(0x7fde48158ea0 msgr2=0x7fde480d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde46800640 1 --2- 172.21.15.161:0/2374158171 >> v2:172.21.15.149:3300/0 conn(0x7fde48158ea0 0x7fde480d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.680+0000 7fde46800640 1 -- 172.21.15.161:0/2374158171 >> v1:172.21.15.161:6789/0 conn(0x7fde480d09a0 legacy=0x7fde480ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.681+0000 7fde46800640 1 -- 172.21.15.161:0/2374158171 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480ceb70 con 0x7fde480caa00 2024-08-17T02:46:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.681+0000 7fde46800640 1 --2- 172.21.15.161:0/2374158171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c7370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde40009f20 tx=0x7fde40009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac98b98a8b1a3fc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde44a00640 1 -- 172.21.15.161:0/2374158171 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40031400 con 0x7fde480caa00 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde44a00640 1 -- 172.21.15.161:0/2374158171 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4002d050 con 0x7fde480caa00 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde44a00640 1 -- 172.21.15.161:0/2374158171 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400317d0 con 0x7fde480caa00 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde4cc00640 1 -- 172.21.15.161:0/2374158171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 msgr2=0x7fde480c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde4cc00640 1 --2- 172.21.15.161:0/2374158171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c7370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde40009f20 tx=0x7fde40009840 comp rx=0 tx=0).stop 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde4cc00640 1 -- 172.21.15.161:0/2374158171 shutdown_connections 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde4cc00640 1 --2- 172.21.15.161:0/2374158171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c7370 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde4cc00640 1 --2- 172.21.15.161:0/2374158171 >> v2:172.21.15.149:3300/0 conn(0x7fde48158ea0 0x7fde480d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.682+0000 7fde4cc00640 1 -- 172.21.15.161:0/2374158171 >> 172.21.15.161:0/2374158171 conn(0x7fde4806eb90 msgr2=0x7fde480cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.683+0000 7fde4cc00640 1 -- 172.21.15.161:0/2374158171 shutdown_connections 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.683+0000 7fde4cc00640 1 -- 172.21.15.161:0/2374158171 wait complete. 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.684+0000 7fde4cc00640 1 Processor -- start 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.684+0000 7fde4cc00640 1 -- start start 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde4cc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde4cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde480d09a0 0x7fde4809d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde4cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde48158ea0 0x7fde48158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde4cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde480c8750 con 0x7fde480d09a0 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde4cc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde480c9790 con 0x7fde48158ea0 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde4cc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480c7e20 con 0x7fde480caa00 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde45e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde46800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde48158ea0 0x7fde48158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde45e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:42536/0 (socket says 172.21.15.161:42536) 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde45e00640 1 -- 172.21.15.161:0/1017069357 learned_addr learned my addr 172.21.15.161:0/1017069357 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.685+0000 7fde45400640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde480d09a0 0x7fde4809d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde46800640 1 -- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 msgr2=0x7fde480c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde46800640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde46800640 1 -- 172.21.15.161:0/1017069357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde480d09a0 msgr2=0x7fde4809d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde46800640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde480d09a0 0x7fde4809d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde46800640 1 -- 172.21.15.161:0/1017069357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009ae0 con 0x7fde48158ea0 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde45400640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde480d09a0 0x7fde4809d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde45e00640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde46800640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde48158ea0 0x7fde48158120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde40030000 tx=0x7fde40036000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40008e50 con 0x7fde48158ea0 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4003b410 con 0x7fde48158ea0 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde480c8100 con 0x7fde48158ea0 2024-08-17T02:46:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.686+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4003b7d0 con 0x7fde48158ea0 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.687+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4809d680 con 0x7fde48158ea0 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.687+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fde40038050 con 0x7fde48158ea0 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.687+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fde4003bd60 con 0x7fde48158ea0 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.688+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde480c88c0 con 0x7fde48158ea0 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.691+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fde40048060 con 0x7fde48158ea0 2024-08-17T02:46:24.751 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:24.750+0000 7fbed3f67ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:46:24.755 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:24.754+0000 7f76dbd66ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:46:24.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.765+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2ddc120-00a5-4eee-a5df-5feefc75e7b8", "id": 2} v 0) v1 -- 0x7fde48071050 con 0x7fde48158ea0 2024-08-17T02:46:24.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.774+0000 7fde3d600640 1 -- 172.21.15.161:0/1017069357 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2ddc120-00a5-4eee-a5df-5feefc75e7b8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde4003f070 con 0x7fde48158ea0 2024-08-17T02:46:24.775 INFO:teuthology.orchestra.run.smithi161.stdout:2 2024-08-17T02:46:24.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde48158ea0 msgr2=0x7fde48158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde48158ea0 0x7fde48158120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde40030000 tx=0x7fde40036000 comp rx=0 tx=0).stop 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 shutdown_connections 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde48158ea0 0x7fde48158120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde480d09a0 0x7fde4809d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 --2- 172.21.15.161:0/1017069357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde480caa00 0x7fde480c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 >> 172.21.15.161:0/1017069357 conn(0x7fde4806eb90 msgr2=0x7fde480b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 shutdown_connections 2024-08-17T02:46:24.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.775+0000 7fde4cc00640 1 -- 172.21.15.161:0/1017069357 wait complete. 2024-08-17T02:46:24.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new c04eba6d-1aab-44bf-b36f-44e3af34ca75 3 2024-08-17T02:46:24.852 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:24.852+0000 7f76dbd66ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:24.857 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:24.857+0000 7fbed3f67ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:24.900 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:24.899+0000 7f76dbd66ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:46:24.909 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:24.908+0000 7fbed3f67ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:46:24.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.934+0000 7f693d600640 1 Processor -- start 2024-08-17T02:46:24.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.934+0000 7f693d600640 1 -- start start 2024-08-17T02:46:24.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.935+0000 7f693d600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6938159f60 0x7f69380cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.935+0000 7f693d600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69380cadc0 con 0x7f6938159b90 2024-08-17T02:46:24.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.935+0000 7f693d600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69380cb060 con 0x7f69380ceb40 2024-08-17T02:46:24.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.935+0000 7f693d600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69380cb880 con 0x7f6938159f60 2024-08-17T02:46:24.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.935+0000 7f693cc00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f69380ceb40 0x7f6938162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33942/0 (socket says 172.21.15.161:33942) 2024-08-17T02:46:24.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.935+0000 7f693cc00640 1 -- 172.21.15.161:0/3615748792 learned_addr learned my addr 172.21.15.161:0/3615748792 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-08-17T02:46:24.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6937400640 1 --2- 172.21.15.161:0/3615748792 >> v2:172.21.15.149:3300/0 conn(0x7f6938159f60 0x7f69380cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153729222 0 0) 0x7f69380cb060 con 0x7f69380ceb40 2024-08-17T02:46:24.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f691c0034e0 con 0x7f69380ceb40 2024-08-17T02:46:24.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 496002958 0 0) 0x7f691c0034e0 con 0x7f69380ceb40 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 >> v2:172.21.15.149:3300/0 conn(0x7f6938159f60 msgr2=0x7f69380cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 --2- 172.21.15.161:0/3615748792 >> v2:172.21.15.149:3300/0 conn(0x7f6938159f60 0x7f69380cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 >> v1:172.21.15.149:6789/0 conn(0x7f6938159b90 legacy=0x7f69380ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69380cb300 con 0x7f69380ceb40 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f69300017f0 con 0x7f69380ceb40 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 >> v1:172.21.15.161:6789/0 conn(0x7f69380ceb40 legacy=0x7f6938162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c0039d0 0x7f691c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c004780 0x7f691c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c005130 0x7f691c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c00bfc0 con 0x7f691c004780 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c00c100 con 0x7f691c0039d0 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.936+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c00c2c0 con 0x7f691c005130 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937e00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c0039d0 0x7f691c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f693cc00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c005130 0x7f691c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937400640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c004780 0x7f691c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937e00640 1 -- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c005130 msgr2=0x7f691c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937e00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c005130 0x7f691c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937e00640 1 -- 172.21.15.161:0/3615748792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c004780 msgr2=0x7f691c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937e00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c004780 0x7f691c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937e00640 1 -- 172.21.15.161:0/3615748792 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0034e0 con 0x7f691c0039d0 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f6937400640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c004780 0x7f691c004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.937+0000 7f693cc00640 1 -- 172.21.15.161:0/3615748792 reap_dead start 2024-08-17T02:46:24.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.938+0000 7f6937e00640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c0039d0 0x7f691c003da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69280019e0 tx=0x7f6928007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4c835deb58671 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.938+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692802aaa0 con 0x7f691c0039d0 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.938+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692802ac20 con 0x7f691c0039d0 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.938+0000 7f6936a00640 1 -- 172.21.15.161:0/3615748792 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69280323f0 con 0x7f691c0039d0 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 -- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c0039d0 msgr2=0x7f691c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c0039d0 0x7f691c003da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69280019e0 tx=0x7f6928007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 -- 172.21.15.161:0/3615748792 shutdown_connections 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 --2- 172.21.15.161:0/3615748792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c0039d0 0x7f691c003da0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 -- 172.21.15.161:0/3615748792 >> 172.21.15.161:0/3615748792 conn(0x7f6938098e00 msgr2=0x7f693806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 -- 172.21.15.161:0/3615748792 shutdown_connections 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.939+0000 7f693d600640 1 -- 172.21.15.161:0/3615748792 wait complete. 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.941+0000 7f693d600640 1 Processor -- start 2024-08-17T02:46:24.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.941+0000 7f693d600640 1 -- start start 2024-08-17T02:46:24.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c0039d0 0x7f693815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693d600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 0x7f69380c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693d600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69380c8ab0 0x7f69380b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693815a6c0 con 0x7f691c0039d0 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693d600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693815d230 con 0x7f69380c8ab0 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693d600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69380b54e0 con 0x7f6938154bc0 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 0x7f69380c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 0x7f69380c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:44970/0 (socket says 172.21.15.161:44970) 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 -- 172.21.15.161:0/3626340131 learned_addr learned my addr 172.21.15.161:0/3626340131 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937e00640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c0039d0 0x7f693815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f693cc00640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69380c8ab0 0x7f69380b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 -- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69380c8ab0 msgr2=0x7f69380b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69380c8ab0 0x7f69380b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 -- 172.21.15.161:0/3626340131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c0039d0 msgr2=0x7f693815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c0039d0 0x7f693815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.942+0000 7f6937400640 1 -- 172.21.15.161:0/3626340131 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69380b4c40 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f6937400640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 0x7f69380c8570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6924011c90 tx=0x7f69240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400fbf0 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400fd50 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924014690 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69380b4f20 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69380c8f30 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6924014c90 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.943+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f6924018070 con 0x7f6938154bc0 2024-08-17T02:46:24.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.944+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693815a830 con 0x7f6938154bc0 2024-08-17T02:46:24.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:24.946+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f692403c7a0 con 0x7f6938154bc0 2024-08-17T02:46:25.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.020+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c04eba6d-1aab-44bf-b36f-44e3af34ca75", "id": 3} v 0) v1 -- 0x7f6938071050 con 0x7f6938154bc0 2024-08-17T02:46:25.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.028+0000 7f692f400640 1 -- 172.21.15.161:0/3626340131 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c04eba6d-1aab-44bf-b36f-44e3af34ca75", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f692402b030 con 0x7f6938154bc0 2024-08-17T02:46:25.029 INFO:teuthology.orchestra.run.smithi161.stdout:3 2024-08-17T02:46:25.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.029+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 msgr2=0x7f69380c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.029+0000 7f693d600640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 0x7f69380c8570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6924011c90 tx=0x7f69240090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 shutdown_connections 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69380c8ab0 0x7f69380b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6938154bc0 0x7f69380c8570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 --2- 172.21.15.161:0/3626340131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c0039d0 0x7f693815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 >> 172.21.15.161:0/3626340131 conn(0x7f6938098e00 msgr2=0x7f69380673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 shutdown_connections 2024-08-17T02:46:25.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.030+0000 7f693d600640 1 -- 172.21.15.161:0/3626340131 wait complete. 2024-08-17T02:46:25.044 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new cca731aa-9929-427b-93b2-7fe5d82ad911 4 2024-08-17T02:46:25.068 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:25.067+0000 7f76dbd66ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:46:25.090 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:25.090+0000 7fbed3f67ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:46:25.128 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:25.127+0000 7f76dbd66ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:46:25.154 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:25.153+0000 7fbed3f67ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:46:25.188 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:25.187+0000 7f76dbd66ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:46:25.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.192+0000 7fd429200640 1 Processor -- start 2024-08-17T02:46:25.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.192+0000 7fd429200640 1 -- start start 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd429200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4240ca2f0 0x7fd4240ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd429200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42406f240 con 0x7fd4240c7370 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd429200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4240cf410 con 0x7fd424158ea0 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd429200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240c6f20 con 0x7fd4240ca2f0 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd421e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd424158ea0 0x7fd4240d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33952/0 (socket says 172.21.15.161:33952) 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd421e00640 1 -- 172.21.15.161:0/1680093663 learned_addr learned my addr 172.21.15.161:0/1680093663 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-08-17T02:46:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.193+0000 7fd421400640 1 --2- 172.21.15.161:0/1680093663 >> v2:172.21.15.161:3300/0 conn(0x7fd4240ca2f0 0x7fd4240ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.194+0000 7fd420a00640 1 -- 172.21.15.161:0/1680093663 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300407245 0 0) 0x7fd4240cf410 con 0x7fd424158ea0 2024-08-17T02:46:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.194+0000 7fd420a00640 1 -- 172.21.15.161:0/1680093663 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4080034e0 con 0x7fd424158ea0 2024-08-17T02:46:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.194+0000 7fd420a00640 1 -- 172.21.15.161:0/1680093663 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788585940 0 0) 0x7fd42406f240 con 0x7fd4240c7370 2024-08-17T02:46:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.194+0000 7fd421400640 1 -- 172.21.15.161:0/1680093663 >> v1:172.21.15.161:6789/0 conn(0x7fd424158ea0 legacy=0x7fd4240d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.194+0000 7fd421400640 1 -- 172.21.15.161:0/1680093663 >> v1:172.21.15.149:6789/0 conn(0x7fd4240c7370 legacy=0x7fd4240c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.194+0000 7fd421400640 1 -- 172.21.15.161:0/1680093663 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240d0b70 con 0x7fd4240ca2f0 2024-08-17T02:46:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.195+0000 7fd421400640 1 --2- 172.21.15.161:0/1680093663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240ca2f0 0x7fd4240ca770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd410009850 tx=0x7fd4100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf3399914c833d96 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd420a00640 1 -- 172.21.15.161:0/1680093663 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41002ad90 con 0x7fd4240ca2f0 2024-08-17T02:46:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd420a00640 1 -- 172.21.15.161:0/1680093663 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410032440 con 0x7fd4240ca2f0 2024-08-17T02:46:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd420a00640 1 -- 172.21.15.161:0/1680093663 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100327e0 con 0x7fd4240ca2f0 2024-08-17T02:46:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 -- 172.21.15.161:0/1680093663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240ca2f0 msgr2=0x7fd4240ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 --2- 172.21.15.161:0/1680093663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240ca2f0 0x7fd4240ca770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd410009850 tx=0x7fd4100090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 -- 172.21.15.161:0/1680093663 shutdown_connections 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 --2- 172.21.15.161:0/1680093663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240ca2f0 0x7fd4240ca770 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 -- 172.21.15.161:0/1680093663 >> 172.21.15.161:0/1680093663 conn(0x7fd42406eb90 msgr2=0x7fd4240cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 -- 172.21.15.161:0/1680093663 shutdown_connections 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.196+0000 7fd429200640 1 -- 172.21.15.161:0/1680093663 wait complete. 2024-08-17T02:46:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.198+0000 7fd429200640 1 Processor -- start 2024-08-17T02:46:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.198+0000 7fd429200640 1 -- start start 2024-08-17T02:46:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd429200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 0x7fd42414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd429200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4240ca2f0 0x7fd42409bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd429200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd424158ea0 0x7fd42409c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd429200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240999b0 con 0x7fd4240ca2f0 2024-08-17T02:46:25.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd429200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424099c90 con 0x7fd4240c7370 2024-08-17T02:46:25.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd429200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd424099f70 con 0x7fd424158ea0 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 0x7fd42414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 0x7fd42414d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45956/0 (socket says 172.21.15.161:45956) 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 -- 172.21.15.161:0/2753358812 learned_addr learned my addr 172.21.15.161:0/2753358812 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4240ca2f0 0x7fd42409bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd422800640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd424158ea0 0x7fd42409c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 -- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd424158ea0 msgr2=0x7fd42409c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd424158ea0 0x7fd42409c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 -- 172.21.15.161:0/2753358812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4240ca2f0 msgr2=0x7fd42409bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4240ca2f0 0x7fd42409bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd421e00640 1 -- 172.21.15.161:0/2753358812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410009390 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.199+0000 7fd422800640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd424158ea0 0x7fd42409c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd421e00640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 0x7fd42414d000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c560 tx=0x7fd414007d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414005aa0 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd414005c00 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42409a250 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140070d0 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42414d540 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd4140074c0 con 0x7fd4240c7370 2024-08-17T02:46:25.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.200+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd41401c440 con 0x7fd4240c7370 2024-08-17T02:46:25.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.201+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd424071050 con 0x7fd4240c7370 2024-08-17T02:46:25.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.204+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd414017070 con 0x7fd4240c7370 2024-08-17T02:46:25.220 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:25.219+0000 7fbed3f67ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:46:25.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.277+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cca731aa-9929-427b-93b2-7fe5d82ad911", "id": 4} v 0) v1 -- 0x7fd4240c77b0 con 0x7fd4240c7370 2024-08-17T02:46:25.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.284+0000 7fd419600640 1 -- 172.21.15.161:0/2753358812 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cca731aa-9929-427b-93b2-7fe5d82ad911", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd41401ca30 con 0x7fd4240c7370 2024-08-17T02:46:25.286 INFO:teuthology.orchestra.run.smithi161.stdout:4 2024-08-17T02:46:25.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 msgr2=0x7fd42414d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 0x7fd42414d000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c560 tx=0x7fd414007d60 comp rx=0 tx=0).stop 2024-08-17T02:46:25.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 shutdown_connections 2024-08-17T02:46:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd424158ea0 0x7fd42409c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4240ca2f0 0x7fd42409bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 --2- 172.21.15.161:0/2753358812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4240c7370 0x7fd42414d000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.285+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 >> 172.21.15.161:0/2753358812 conn(0x7fd42406eb90 msgr2=0x7fd4240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.286+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 shutdown_connections 2024-08-17T02:46:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.286+0000 7fd429200640 1 -- 172.21.15.161:0/2753358812 wait complete. 2024-08-17T02:46:25.296 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:25.295+0000 7f76dbd66ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:25.300 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a 5 2024-08-17T02:46:25.335 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:25.335+0000 7fbed3f67ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:25.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.447+0000 7fa673200640 1 Processor -- start 2024-08-17T02:46:25.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.447+0000 7fa673200640 1 -- start start 2024-08-17T02:46:25.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.448+0000 7fa673200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa674159b90 0x7fa6740ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.448+0000 7fa673200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 0x7fa6740cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.448+0000 7fa673200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740cadc0 con 0x7fa674159f60 2024-08-17T02:46:25.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.448+0000 7fa673200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740cb880 con 0x7fa674159b90 2024-08-17T02:46:25.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.448+0000 7fa673200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740cd6e0 con 0x7fa6740ca8a0 2024-08-17T02:46:25.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.448+0000 7fa671400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 0x7fa6740cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 0x7fa6740cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:44996/0 (socket says 172.21.15.161:44996) 2024-08-17T02:46:25.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671400640 1 -- 172.21.15.161:0/2120351492 learned_addr learned my addr 172.21.15.161:0/2120351492 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:25.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671e00640 1 --2- 172.21.15.161:0/2120351492 >> v2:172.21.15.149:3300/0 conn(0x7fa674159b90 0x7fa6740ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671400640 1 -- 172.21.15.161:0/2120351492 >> v2:172.21.15.149:3300/0 conn(0x7fa674159b90 msgr2=0x7fa6740ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671400640 1 --2- 172.21.15.161:0/2120351492 >> v2:172.21.15.149:3300/0 conn(0x7fa674159b90 0x7fa6740ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671400640 1 -- 172.21.15.161:0/2120351492 >> v1:172.21.15.149:6789/0 conn(0x7fa674159f60 legacy=0x7fa6740cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.449+0000 7fa671400640 1 -- 172.21.15.161:0/2120351492 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740cb060 con 0x7fa6740ca8a0 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.450+0000 7fa671400640 1 --2- 172.21.15.161:0/2120351492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 0x7fa6740cc590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa660009910 tx=0x7fa6600091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c865b9e7fb9fcd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.450+0000 7fa670a00640 1 -- 172.21.15.161:0/2120351492 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66002ae40 con 0x7fa6740ca8a0 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.450+0000 7fa670a00640 1 -- 172.21.15.161:0/2120351492 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660032440 con 0x7fa6740ca8a0 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.450+0000 7fa670a00640 1 -- 172.21.15.161:0/2120351492 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660032820 con 0x7fa6740ca8a0 2024-08-17T02:46:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 -- 172.21.15.161:0/2120351492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 msgr2=0x7fa6740cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 --2- 172.21.15.161:0/2120351492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 0x7fa6740cc590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa660009910 tx=0x7fa6600091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 -- 172.21.15.161:0/2120351492 shutdown_connections 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 --2- 172.21.15.161:0/2120351492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6740ca8a0 0x7fa6740cc590 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 --2- 172.21.15.161:0/2120351492 >> v2:172.21.15.149:3300/0 conn(0x7fa674159b90 0x7fa6740ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 -- 172.21.15.161:0/2120351492 >> 172.21.15.161:0/2120351492 conn(0x7fa674098e00 msgr2=0x7fa67406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 -- 172.21.15.161:0/2120351492 shutdown_connections 2024-08-17T02:46:25.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.451+0000 7fa673200640 1 -- 172.21.15.161:0/2120351492 wait complete. 2024-08-17T02:46:25.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.453+0000 7fa673200640 1 Processor -- start 2024-08-17T02:46:25.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.454+0000 7fa673200640 1 -- start start 2024-08-17T02:46:25.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa673200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6740ca8a0 0x7fa6741692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa673200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 0x7fa6740b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa673200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa674159f60 0x7fa67416be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa673200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740b54d0 con 0x7fa674159b90 2024-08-17T02:46:25.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa673200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740c7ab0 con 0x7fa6740ca8a0 2024-08-17T02:46:25.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa673200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740c6bc0 con 0x7fa674159f60 2024-08-17T02:46:25.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa671e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6740ca8a0 0x7fa6741692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa672800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa674159f60 0x7fa67416be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa671400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 0x7fa6740b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa671400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 0x7fa6740b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.161:48370/0 (socket says 172.21.15.161:48370) 2024-08-17T02:46:25.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa671e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6740ca8a0 0x7fa6741692a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45972/0 (socket says 172.21.15.161:45972) 2024-08-17T02:46:25.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.455+0000 7fa671400640 1 -- 172.21.15.161:0/2126314110 learned_addr learned my addr 172.21.15.161:0/2126314110 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa671400640 1 -- 172.21.15.161:0/2126314110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa674159f60 msgr2=0x7fa67416be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa671400640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa674159f60 0x7fa67416be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa671400640 1 -- 172.21.15.161:0/2126314110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6740ca8a0 msgr2=0x7fa6741692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa671400640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6740ca8a0 0x7fa6741692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa671400640 1 -- 172.21.15.161:0/2126314110 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660009450 con 0x7fa674159b90 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa671400640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 0x7fa6740b3340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa660035040 tx=0x7fa660032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660031bb0 con 0x7fa674159b90 2024-08-17T02:46:25.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660031d70 con 0x7fa674159b90 2024-08-17T02:46:25.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740c6ea0 con 0x7fa674159b90 2024-08-17T02:46:25.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.456+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66003d670 con 0x7fa674159b90 2024-08-17T02:46:25.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.457+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6740c7460 con 0x7fa674159b90 2024-08-17T02:46:25.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.457+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa660039040 con 0x7fa674159b90 2024-08-17T02:46:25.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.457+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fa66002ae40 con 0x7fa674159b90 2024-08-17T02:46:25.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.458+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6740c7c20 con 0x7fa674159b90 2024-08-17T02:46:25.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.461+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa660042070 con 0x7fa674159b90 2024-08-17T02:46:25.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.551+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a", "id": 5} v 0) v1 -- 0x7fa674071050 con 0x7fa674159b90 2024-08-17T02:46:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.558+0000 7fa669600640 1 -- 172.21.15.161:0/2126314110 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa660037070 con 0x7fa674159b90 2024-08-17T02:46:25.560 INFO:teuthology.orchestra.run.smithi161.stdout:5 2024-08-17T02:46:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.559+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 msgr2=0x7fa6740b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.559+0000 7fa673200640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 0x7fa6740b3340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa660035040 tx=0x7fa660032000 comp rx=0 tx=0).stop 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 shutdown_connections 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa674159f60 0x7fa67416be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa674159b90 0x7fa6740b3340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 --2- 172.21.15.161:0/2126314110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6740ca8a0 0x7fa6741692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 >> 172.21.15.161:0/2126314110 conn(0x7fa674098e00 msgr2=0x7fa674155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 shutdown_connections 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.560+0000 7fa673200640 1 -- 172.21.15.161:0/2126314110 wait complete. 2024-08-17T02:46:25.575 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 998f3043-15f6-46ab-a89b-5c5246f12224 6 2024-08-17T02:46:25.748 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:25.747+0000 7f76dbd66ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:46:25.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.760+0000 7f612ec00640 1 Processor -- start 2024-08-17T02:46:25.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.761+0000 7f612ec00640 1 -- start start 2024-08-17T02:46:25.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f612ec00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f61280ae0d0 0x7f61280aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f612ec00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61280b11d0 con 0x7f6128159200 2024-08-17T02:46:25.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f612ec00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61280b0650 con 0x7f61280d0490 2024-08-17T02:46:25.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f612ec00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280b08a0 con 0x7f61280ae0d0 2024-08-17T02:46:25.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f611fe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f61280d0490 0x7f61280b2ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33960/0 (socket says 172.21.15.161:33960) 2024-08-17T02:46:25.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f611fe00640 1 -- 172.21.15.161:0/3093839503 learned_addr learned my addr 172.21.15.161:0/3093839503 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-08-17T02:46:25.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f612cc00640 1 --2- 172.21.15.161:0/3093839503 >> v2:172.21.15.149:3300/0 conn(0x7f61280ae0d0 0x7f61280aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184446091 0 0) 0x7f61280b0650 con 0x7f61280d0490 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f610c0034e0 con 0x7f61280d0490 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.762+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624767264 0 0) 0x7f61280b11d0 con 0x7f6128159200 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.763+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61280b0650 con 0x7f6128159200 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.763+0000 7f612cc00640 1 -- 172.21.15.161:0/3093839503 >> v1:172.21.15.161:6789/0 conn(0x7f61280d0490 legacy=0x7f61280b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.763+0000 7f612cc00640 1 -- 172.21.15.161:0/3093839503 >> v1:172.21.15.149:6789/0 conn(0x7f6128159200 legacy=0x7f61280ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.763+0000 7f612cc00640 1 -- 172.21.15.161:0/3093839503 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280b0b80 con 0x7f61280ae0d0 2024-08-17T02:46:25.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.764+0000 7f612cc00640 1 --2- 172.21.15.161:0/3093839503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61280ae0d0 0x7f61280aeeb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e60 tx=0x7f6120009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957fc9b11b28450e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.764+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120030550 con 0x7f61280ae0d0 2024-08-17T02:46:25.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.764+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61200306b0 con 0x7f61280ae0d0 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.764+0000 7f6127400640 1 -- 172.21.15.161:0/3093839503 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120030a50 con 0x7f61280ae0d0 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.764+0000 7f612ec00640 1 -- 172.21.15.161:0/3093839503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61280ae0d0 msgr2=0x7f61280aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.764+0000 7f612ec00640 1 --2- 172.21.15.161:0/3093839503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61280ae0d0 0x7f61280aeeb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e60 tx=0x7f6120009780 comp rx=0 tx=0).stop 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.765+0000 7f612ec00640 1 -- 172.21.15.161:0/3093839503 shutdown_connections 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.765+0000 7f612ec00640 1 --2- 172.21.15.161:0/3093839503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61280ae0d0 0x7f61280aeeb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.765+0000 7f612ec00640 1 -- 172.21.15.161:0/3093839503 >> 172.21.15.161:0/3093839503 conn(0x7f612806eb90 msgr2=0x7f61280cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.765+0000 7f612ec00640 1 -- 172.21.15.161:0/3093839503 shutdown_connections 2024-08-17T02:46:25.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.765+0000 7f612ec00640 1 -- 172.21.15.161:0/3093839503 wait complete. 2024-08-17T02:46:25.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.766+0000 7f612ec00640 1 Processor -- start 2024-08-17T02:46:25.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.766+0000 7f612ec00640 1 -- start start 2024-08-17T02:46:25.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612ec00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 0x7f61281505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612ec00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61280d0490 0x7f61281692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6128159200 0x7f612814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612809c560 con 0x7f6128159200 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612ec00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281539f0 con 0x7f61280ae0d0 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612ec00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612809bc30 con 0x7f61280d0490 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f6127e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 0x7f61281505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f611fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61280d0490 0x7f61281692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f6127e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 0x7f61281505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45974/0 (socket says 172.21.15.161:45974) 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f6127e00640 1 -- 172.21.15.161:0/2089127552 learned_addr learned my addr 172.21.15.161:0/2089127552 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.767+0000 7f612cc00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6128159200 0x7f612814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f6127e00640 1 -- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61280d0490 msgr2=0x7f61281692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f6127e00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61280d0490 0x7f61281692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f6127e00640 1 -- 172.21.15.161:0/2089127552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6128159200 msgr2=0x7f612814e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f6127e00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6128159200 0x7f612814e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f6127e00640 1 -- 172.21.15.161:0/2089127552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120009a20 con 0x7f61280ae0d0 2024-08-17T02:46:25.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f611fe00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61280d0490 0x7f61281692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:25.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f6127e00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 0x7f61281505d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f611800c4e0 tx=0x7f6118007d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118016070 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118011590 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612809bf10 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011990 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.768+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61281697e0 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.769+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6118012420 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.769+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f6118011dc0 con 0x7f61280ae0d0 2024-08-17T02:46:25.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.769+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128071050 con 0x7f61280ae0d0 2024-08-17T02:46:25.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.772+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f61180126d0 con 0x7f61280ae0d0 2024-08-17T02:46:25.832 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:25.832+0000 7fbed3f67ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:46:25.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.844+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "998f3043-15f6-46ab-a89b-5c5246f12224", "id": 6} v 0) v1 -- 0x7f61280b4de0 con 0x7f61280ae0d0 2024-08-17T02:46:25.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.850+0000 7f611f400640 1 -- 172.21.15.161:0/2089127552 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "998f3043-15f6-46ab-a89b-5c5246f12224", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6118012870 con 0x7f61280ae0d0 2024-08-17T02:46:25.851 INFO:teuthology.orchestra.run.smithi161.stdout:6 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 msgr2=0x7f61281505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 0x7f61281505d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f611800c4e0 tx=0x7f6118007d80 comp rx=0 tx=0).stop 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 shutdown_connections 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6128159200 0x7f612814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61280d0490 0x7f61281692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 --2- 172.21.15.161:0/2089127552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61280ae0d0 0x7f61281505d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 >> 172.21.15.161:0/2089127552 conn(0x7f612806eb90 msgr2=0x7f6128158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 shutdown_connections 2024-08-17T02:46:25.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:25.851+0000 7f612ec00640 1 -- 172.21.15.161:0/2089127552 wait complete. 2024-08-17T02:46:25.865 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3 7 2024-08-17T02:46:26.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.009+0000 7f36b7a00640 1 Processor -- start 2024-08-17T02:46:26.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.009+0000 7f36b7a00640 1 -- start start 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.010+0000 7f36b7a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36b0158ea0 0x7f36b00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.010+0000 7f36b7a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 0x7f36b00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.010+0000 7f36b7a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b006f240 con 0x7f36b00d09a0 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.010+0000 7f36b7a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00c6f20 con 0x7f36b0158ea0 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.010+0000 7f36b7a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00cf410 con 0x7f36b00caa00 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 0x7f36b00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 0x7f36b00c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:45018/0 (socket says 172.21.15.161:45018) 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 -- 172.21.15.161:0/145589938 learned_addr learned my addr 172.21.15.161:0/145589938 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5000640 1 --2- 172.21.15.161:0/145589938 >> v2:172.21.15.149:3300/0 conn(0x7f36b0158ea0 0x7f36b00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 -- 172.21.15.161:0/145589938 >> v2:172.21.15.149:3300/0 conn(0x7f36b0158ea0 msgr2=0x7f36b00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:26.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 --2- 172.21.15.161:0/145589938 >> v2:172.21.15.149:3300/0 conn(0x7f36b0158ea0 0x7f36b00d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 -- 172.21.15.161:0/145589938 >> v1:172.21.15.149:6789/0 conn(0x7f36b00d09a0 legacy=0x7f36b00ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36b5a00640 1 -- 172.21.15.161:0/145589938 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00ceb70 con 0x7f36b00caa00 2024-08-17T02:46:26.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.011+0000 7f36af400640 1 -- 172.21.15.161:0/145589938 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636537147 0 0) 0x7f36b006f240 con 0x7f36b00d09a0 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.012+0000 7f36b5a00640 1 --2- 172.21.15.161:0/145589938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 0x7f36b00c7370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009f20 tx=0x7f36a8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d667f89b2e916f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.012+0000 7f36af400640 1 -- 172.21.15.161:0/145589938 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8031400 con 0x7f36b00caa00 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36af400640 1 -- 172.21.15.161:0/145589938 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a802d050 con 0x7f36b00caa00 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36af400640 1 -- 172.21.15.161:0/145589938 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8031790 con 0x7f36b00caa00 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 -- 172.21.15.161:0/145589938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 msgr2=0x7f36b00c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 --2- 172.21.15.161:0/145589938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 0x7f36b00c7370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009f20 tx=0x7f36a8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:26.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 -- 172.21.15.161:0/145589938 shutdown_connections 2024-08-17T02:46:26.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 --2- 172.21.15.161:0/145589938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00caa00 0x7f36b00c7370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 --2- 172.21.15.161:0/145589938 >> v2:172.21.15.149:3300/0 conn(0x7f36b0158ea0 0x7f36b00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 -- 172.21.15.161:0/145589938 >> 172.21.15.161:0/145589938 conn(0x7f36b006eb90 msgr2=0x7f36b00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 -- 172.21.15.161:0/145589938 shutdown_connections 2024-08-17T02:46:26.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.013+0000 7f36b7a00640 1 -- 172.21.15.161:0/145589938 wait complete. 2024-08-17T02:46:26.015 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.015+0000 7f76dbd66ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:46:26.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.015+0000 7f36b7a00640 1 Processor -- start 2024-08-17T02:46:26.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.015+0000 7f36b7a00640 1 -- start start 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b7a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 0x7f36b00b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b7a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00d09a0 0x7f36b00b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b7a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b0158ea0 0x7f36b014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b7a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00b5180 con 0x7f36b0158ea0 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b7a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00c5e50 con 0x7f36b00caa00 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b7a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00b3ba0 con 0x7f36b00d09a0 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 0x7f36b00b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36afe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00d09a0 0x7f36b00b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 0x7f36b00b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45984/0 (socket says 172.21.15.161:45984) 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 -- 172.21.15.161:0/3220440073 learned_addr learned my addr 172.21.15.161:0/3220440073 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5a00640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b0158ea0 0x7f36b014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 -- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00d09a0 msgr2=0x7f36b00b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00d09a0 0x7f36b00b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 -- 172.21.15.161:0/3220440073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b0158ea0 msgr2=0x7f36b014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.016+0000 7f36b5000640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b0158ea0 0x7f36b014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36b5000640 1 -- 172.21.15.161:0/3220440073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8009ae0 con 0x7f36b00caa00 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36afe00640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00d09a0 0x7f36b00b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36b5000640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 0x7f36b00b3510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f36a400e900 tx=0x7f36a40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400c8e0 con 0x7f36b00caa00 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400ca40 con 0x7f36b00caa00 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b00b3e80 con 0x7f36b00caa00 2024-08-17T02:46:26.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400cde0 con 0x7f36b00caa00 2024-08-17T02:46:26.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b00b4440 con 0x7f36b00caa00 2024-08-17T02:46:26.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f36a4005970 con 0x7f36b00caa00 2024-08-17T02:46:26.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.017+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f36a4005c20 con 0x7f36b00caa00 2024-08-17T02:46:26.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.018+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b0071050 con 0x7f36b00caa00 2024-08-17T02:46:26.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.020+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f36a4021060 con 0x7f36b00caa00 2024-08-17T02:46:26.076 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.075+0000 7f76dbd66ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:46:26.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.093+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3", "id": 7} v 0) v1 -- 0x7f36b00cf600 con 0x7f36b00caa00 2024-08-17T02:46:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.098+0000 7f36a3e00640 1 -- 172.21.15.161:0/3220440073 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36a4029020 con 0x7f36b00caa00 2024-08-17T02:46:26.099 INFO:teuthology.orchestra.run.smithi161.stdout:7 2024-08-17T02:46:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 msgr2=0x7f36b00b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 0x7f36b00b3510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f36a400e900 tx=0x7f36a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 shutdown_connections 2024-08-17T02:46:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b0158ea0 0x7f36b014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36b00d09a0 0x7f36b00b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 --2- 172.21.15.161:0/3220440073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b00caa00 0x7f36b00b3510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 >> 172.21.15.161:0/3220440073 conn(0x7f36b006eb90 msgr2=0x7f36b00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 shutdown_connections 2024-08-17T02:46:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-08-17T02:46:26.099+0000 7f36b7a00640 1 -- 172.21.15.161:0/3220440073 wait complete. 2024-08-17T02:46:26.115 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:46:26.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:46:26.120 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:46:26.120 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:46:26.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:46:26.121 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.120+0000 7fbed3f67ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:46:26.124 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:46:26.124 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:46:26.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:46:26.129 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:46:26.129 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:46:26.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:46:26.134 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:46:26.134 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:46:26.135 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:46:26.138 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:46:26.139 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:46:26.139 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:46:26.142 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:46:26.143 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:46:26.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:46:26.146 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:46:26.147 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:46:26.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:46:26.155 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:46:26.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:26.198 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.197+0000 7fbed3f67ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:46:26.214 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.214+0000 7f76dbd66ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:46:26.342 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.341+0000 7fbed3f67ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:46:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.346+0000 7f12f7000640 1 Processor -- start 2024-08-17T02:46:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.346+0000 7f12f7000640 1 -- start start 2024-08-17T02:46:26.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12f7000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0159350 0x7f12f00ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12f7000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f00cb560 con 0x7f12f00caa40 2024-08-17T02:46:26.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12f7000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f00cf7e0 con 0x7f12f0158f80 2024-08-17T02:46:26.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12f7000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00cfac0 con 0x7f12f0159350 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12ef400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f12f00caa40 0x7f12f00ace40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40334/0 (socket says 172.21.15.149:40334) 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12ef400640 1 -- 172.21.15.149:0/1477688956 learned_addr learned my addr 172.21.15.149:0/1477688956 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.347+0000 7f12f5000640 1 --2- 172.21.15.149:0/1477688956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0159350 0x7f12f00ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300596721 0 0) 0x7f12f00cf7e0 con 0x7f12f0158f80 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d40034e0 con 0x7f12f0158f80 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763168662 0 0) 0x7f12f00cb560 con 0x7f12f00caa40 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f00cf7e0 con 0x7f12f00caa40 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12f5000640 1 -- 172.21.15.149:0/1477688956 >> v1:172.21.15.161:6789/0 conn(0x7f12f0158f80 legacy=0x7f12f00ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12f5000640 1 -- 172.21.15.149:0/1477688956 >> v1:172.21.15.149:6789/0 conn(0x7f12f00caa40 legacy=0x7f12f00ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.348+0000 7f12f5000640 1 -- 172.21.15.149:0/1477688956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00caf10 con 0x7f12f0159350 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.349+0000 7f12f5000640 1 --2- 172.21.15.149:0/1477688956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0159350 0x7f12f00ad550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009e90 tx=0x7f12e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadc6ad60e65d4d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.349+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8007550 con 0x7f12f0159350 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.349+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e802d050 con 0x7f12f0159350 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.349+0000 7f12eea00640 1 -- 172.21.15.149:0/1477688956 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80078e0 con 0x7f12f0159350 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 -- 172.21.15.149:0/1477688956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0159350 msgr2=0x7f12f00ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 --2- 172.21.15.149:0/1477688956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0159350 0x7f12f00ad550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009e90 tx=0x7f12e8009780 comp rx=0 tx=0).stop 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 -- 172.21.15.149:0/1477688956 shutdown_connections 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 --2- 172.21.15.149:0/1477688956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0159350 0x7f12f00ad550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 -- 172.21.15.149:0/1477688956 >> 172.21.15.149:0/1477688956 conn(0x7f12f00cfd90 msgr2=0x7f12f00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 -- 172.21.15.149:0/1477688956 shutdown_connections 2024-08-17T02:46:26.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.350+0000 7f12f7000640 1 -- 172.21.15.149:0/1477688956 wait complete. 2024-08-17T02:46:26.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.351+0000 7f12f7000640 1 Processor -- start 2024-08-17T02:46:26.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 -- start start 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12f00caa40 0x7f12f016ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0158f80 0x7f12f00c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 0x7f12f00b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f016c9d0 con 0x7f12f00caa40 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f009d6f0 con 0x7f12f0159350 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.352+0000 7f12f7000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00b36d0 con 0x7f12f0158f80 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 0x7f12f00b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 0x7f12f00b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:41612/0 (socket says 172.21.15.149:41612) 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 -- 172.21.15.149:0/3034791740 learned_addr learned my addr 172.21.15.149:0/3034791740 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12ef400640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0158f80 0x7f12f00c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12efe00640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12f00caa40 0x7f12f016ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 -- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0158f80 msgr2=0x7f12f00c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0158f80 0x7f12f00c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 -- 172.21.15.149:0/3034791740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12f00caa40 msgr2=0x7f12f016ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12f00caa40 0x7f12f016ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.353+0000 7f12f5000640 1 -- 172.21.15.149:0/3034791740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8009a20 con 0x7f12f0159350 2024-08-17T02:46:26.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12f5000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 0x7f12f00b2b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009de0 tx=0x7f12e8037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80318b0 con 0x7f12f0159350 2024-08-17T02:46:26.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8040070 con 0x7f12f0159350 2024-08-17T02:46:26.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8031c20 con 0x7f12f0159350 2024-08-17T02:46:26.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f00b39b0 con 0x7f12f0159350 2024-08-17T02:46:26.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f016c660 con 0x7f12f0159350 2024-08-17T02:46:26.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f12e8042030 con 0x7f12f0159350 2024-08-17T02:46:26.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.354+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f12e8031d80 con 0x7f12f0159350 2024-08-17T02:46:26.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.355+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f016cb40 con 0x7f12f0159350 2024-08-17T02:46:26.358 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.358+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f12e803b420 con 0x7f12f0159350 2024-08-17T02:46:26.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.419+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12f0064db0 con 0x7f12f0159350 2024-08-17T02:46:26.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.420+0000 7f12e7400640 1 -- 172.21.15.149:0/3034791740 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f12e8054020 con 0x7f12f0159350 2024-08-17T02:46:26.421 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:26.421 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":10,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:26.094663+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:26.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 msgr2=0x7f12f00b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 0x7f12f00b2b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009de0 tx=0x7f12e8037000 comp rx=0 tx=0).stop 2024-08-17T02:46:26.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 shutdown_connections 2024-08-17T02:46:26.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f0159350 0x7f12f00b2b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12f0158f80 0x7f12f00c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 --2- 172.21.15.149:0/3034791740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12f00caa40 0x7f12f016ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 >> 172.21.15.149:0/3034791740 conn(0x7f12f00cfd90 msgr2=0x7f12f01568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 shutdown_connections 2024-08-17T02:46:26.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:26.421+0000 7f12f7000640 1 -- 172.21.15.149:0/3034791740 wait complete. 2024-08-17T02:46:26.437 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:46:26.437 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:46:26.536 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.535+0000 7f76dbd66ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:46:26.591 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.590+0000 7f76dbd66ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:46:26.643 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.643+0000 7fbed3f67ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:46:26.696 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.696+0000 7fbed3f67ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:46:26.769 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.768+0000 7f76dbd66ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:46:26.808 INFO:tasks.ceph.osd.0.smithi149.stderr:2024-08-17T02:46:26.808+0000 7ff9b6b232c0 -1 Falling back to public interface 2024-08-17T02:46:26.810 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-08-17T02:46:26.810+0000 7f1fa44752c0 -1 Falling back to public interface 2024-08-17T02:46:26.824 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-08-17T02:46:26.824+0000 7f9ec992f2c0 -1 Falling back to public interface 2024-08-17T02:46:26.826 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.825+0000 7f76dbd66ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:46:26.828 INFO:tasks.ceph.osd.3.smithi149.stderr:2024-08-17T02:46:26.828+0000 7f7848e1c2c0 -1 Falling back to public interface 2024-08-17T02:46:26.833 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-08-17T02:46:26.833+0000 7f2971c082c0 -1 Falling back to public interface 2024-08-17T02:46:26.834 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-08-17T02:46:26.834+0000 7f1bd26112c0 -1 Falling back to public interface 2024-08-17T02:46:26.842 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-08-17T02:46:26.842+0000 7f1a1a2132c0 -1 Falling back to public interface 2024-08-17T02:46:26.846 INFO:tasks.ceph.osd.2.smithi149.stderr:2024-08-17T02:46:26.846+0000 7f0b862752c0 -1 Falling back to public interface 2024-08-17T02:46:26.882 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.881+0000 7fbed3f67ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:46:26.910 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.910+0000 7f76dbd66ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:26.938 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:26.938+0000 7fbed3f67ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:46:26.961 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:26.960+0000 7f76dbd66ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:46:27.016 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:27.015+0000 7fbed3f67ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:27.066 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:27.066+0000 7fbed3f67ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:46:27.242 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:27.374 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.374+0000 7fd4fee00640 1 Processor -- start 2024-08-17T02:46:27.375 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.374+0000 7fd4fee00640 1 -- start start 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fee00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4f80cc320 0x7fd4f80cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80ce3b0 con 0x7fd4f80c6c30 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fee00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f80ce650 con 0x7fd4f80cc320 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80ce910 con 0x7fd4f80cd750 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fda00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4f80cc320 0x7fd4f80cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fe400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd4f80c6c30 0x7fd4f80c7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42284/0 (socket says 172.21.15.149:42284) 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fe400640 1 -- 172.21.15.149:0/4152348101 learned_addr learned my addr 172.21.15.149:0/4152348101 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fda00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4f80cc320 0x7fd4f80cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39152/0 (socket says 172.21.15.149:39152) 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.375+0000 7fd4fd000640 1 --2- 172.21.15.149:0/4152348101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.382 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.376+0000 7fd4fda00640 1 -- 172.21.15.149:0/4152348101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 msgr2=0x7fd4f80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.376+0000 7fd4fda00640 1 --2- 172.21.15.149:0/4152348101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f80cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.376+0000 7fd4fda00640 1 -- 172.21.15.149:0/4152348101 >> v1:172.21.15.149:6789/0 conn(0x7fd4f80c6c30 legacy=0x7fd4f80c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.376+0000 7fd4fda00640 1 -- 172.21.15.149:0/4152348101 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80cebf0 con 0x7fd4f80cc320 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.376+0000 7fd4f7e00640 1 -- 172.21.15.149:0/4152348101 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597298006 0 0) 0x7fd4f80ce3b0 con 0x7fd4f80c6c30 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.377+0000 7fd4fda00640 1 --2- 172.21.15.149:0/4152348101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80cf3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009e60 tx=0x7fd4ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0239390ff0cdcf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.377+0000 7fd4f7e00640 1 -- 172.21.15.149:0/4152348101 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec007550 con 0x7fd4f80cc320 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.377+0000 7fd4f7e00640 1 -- 172.21.15.149:0/4152348101 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec02d050 con 0x7fd4f80cc320 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.377+0000 7fd4f7e00640 1 -- 172.21.15.149:0/4152348101 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0078e0 con 0x7fd4f80cc320 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 -- 172.21.15.149:0/4152348101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 msgr2=0x7fd4f80cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 --2- 172.21.15.149:0/4152348101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80cf3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009e60 tx=0x7fd4ec009780 comp rx=0 tx=0).stop 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 -- 172.21.15.149:0/4152348101 shutdown_connections 2024-08-17T02:46:27.383 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 --2- 172.21.15.149:0/4152348101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f80cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 --2- 172.21.15.149:0/4152348101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80cf3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 -- 172.21.15.149:0/4152348101 >> 172.21.15.149:0/4152348101 conn(0x7fd4f8089140 msgr2=0x7fd4f8089540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 -- 172.21.15.149:0/4152348101 shutdown_connections 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.378+0000 7fd4fee00640 1 -- 172.21.15.149:0/4152348101 wait complete. 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.379+0000 7fd4fee00640 1 Processor -- start 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.379+0000 7fd4fee00640 1 -- start start 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fee00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4f80c6c30 0x7fd4f80b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f8156280 con 0x7fd4f80cc320 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fee00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80c62d0 con 0x7fd4f80c6c30 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80c4a50 con 0x7fd4f80cd750 2024-08-17T02:46:27.384 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.380+0000 7fd4fe400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39154/0 (socket says 172.21.15.149:39154) 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4f80c6c30 0x7fd4f80b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 -- 172.21.15.149:0/1454269054 learned_addr learned my addr 172.21.15.149:0/1454269054 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 -- 172.21.15.149:0/1454269054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 msgr2=0x7fd4f8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 -- 172.21.15.149:0/1454269054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4f80c6c30 msgr2=0x7fd4f80b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4f80c6c30 0x7fd4f80b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 -- 172.21.15.149:0/1454269054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009a20 con 0x7fd4f80cc320 2024-08-17T02:46:27.385 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4fd000640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80b35a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400e900 tx=0x7fd4e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.386 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.381+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400ee90 con 0x7fd4f80cc320 2024-08-17T02:46:27.386 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.382+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400c8e0 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.382+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400cc80 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.382+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80c57f0 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.382+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f80c5db0 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.382+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd4e4005970 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.382+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fd4e4005c20 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.383+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f8071100 con 0x7fd4f80cc320 2024-08-17T02:46:27.387 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.385+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd4e4021060 con 0x7fd4f80cc320 2024-08-17T02:46:27.450 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.450+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4f8089c50 con 0x7fd4f80cc320 2024-08-17T02:46:27.451 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.450+0000 7fd4f4c00640 1 -- 172.21.15.149:0/1454269054 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd4e4029020 con 0x7fd4f80cc320 2024-08-17T02:46:27.451 INFO:teuthology.misc.health.smithi149.stdout: 2024-08-17T02:46:27.452 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":10,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:26.094663+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:27.452 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 msgr2=0x7fd4f80b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.452 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80b35a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400e900 tx=0x7fd4e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 shutdown_connections 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4f80cd750 0x7fd4f8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f80cc320 0x7fd4f80b35a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 --2- 172.21.15.149:0/1454269054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4f80c6c30 0x7fd4f80b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.451+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 >> 172.21.15.149:0/1454269054 conn(0x7fd4f8089140 msgr2=0x7fd4f8067880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.452+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 shutdown_connections 2024-08-17T02:46:27.453 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:27.452+0000 7fd4fee00640 1 -- 172.21.15.149:0/1454269054 wait complete. 2024-08-17T02:46:27.464 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:46:27.502 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:27.502+0000 7f76dbd66ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:46:27.594 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:27.593+0000 7fbed3f67ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:46:27.610 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:27.610+0000 7f76dbd66ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:46:27.710 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-08-17T02:46:27.710+0000 7fbed3f67ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:46:28.629 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:28.628+0000 7f76c0000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:46:28.629 INFO:tasks.ceph.mgr.y.smithi149.stderr:2024-08-17T02:46:28.628+0000 7f76c0000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:46:30.350 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-08-17T02:46:30.349+0000 7f1fa44752c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:46:30.376 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-08-17T02:46:30.375+0000 7f9ec992f2c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:46:30.388 INFO:tasks.ceph.osd.0.smithi149.stderr:2024-08-17T02:46:30.388+0000 7ff9b6b232c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:46:30.454 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-08-17T02:46:30.454+0000 7f1bd26112c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:46:30.464 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-08-17T02:46:30.463+0000 7f2971c082c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:46:30.674 INFO:tasks.ceph.osd.3.smithi149.stderr:2024-08-17T02:46:30.674+0000 7f7848e1c2c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:46:30.677 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-08-17T02:46:30.676+0000 7f1a1a2132c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:46:30.678 INFO:tasks.ceph.osd.2.smithi149.stderr:2024-08-17T02:46:30.678+0000 7f0b862752c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:46:32.713 INFO:tasks.ceph.osd.0.smithi149.stderr:2024-08-17T02:46:32.712+0000 7ff9b0200640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:46:32.719 INFO:tasks.ceph.osd.0.smithi149.stderr:2024-08-17T02:46:32.718+0000 7ff9a7600640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:33.954 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-08-17T02:46:33.954+0000 7f296b000640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:46:33.962 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-08-17T02:46:33.961+0000 7f2962400640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:33.980 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-08-17T02:46:33.979+0000 7f1fa0000640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:46:33.990 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-08-17T02:46:33.990+0000 7f1f95600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:33.991 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-08-17T02:46:33.991+0000 7f9ec3000640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:46:33.998 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-08-17T02:46:33.998+0000 7f9eba400640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:34.012 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-08-17T02:46:34.012+0000 7f1bcba00640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:46:34.017 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-08-17T02:46:34.016+0000 7f1bc2e00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:34.271 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:34.415 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-08-17T02:46:34.415+0000 7f1a13600640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:46:34.424 INFO:tasks.ceph.osd.1.smithi149.stderr:2024-08-17T02:46:34.424+0000 7f1a0aa00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:34.470 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.468+0000 7ff1ea400640 1 Processor -- start 2024-08-17T02:46:34.470 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.469+0000 7ff1ea400640 1 -- start start 2024-08-17T02:46:34.471 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.470+0000 7ff1ea400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1e40af6b0 0x7ff1e40afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.471 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1ea400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40ad9f0 0x7ff1e40ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1ea400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40ad560 con 0x7ff1e40b1730 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1ea400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e415e540 con 0x7ff1e40af6b0 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1ea400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e415df80 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1e9000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1e40af6b0 0x7ff1e40afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1e3e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff1e40b1730 0x7ff1e415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:52376/0 (socket says 172.21.15.149:52376) 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1e3e00640 1 -- 172.21.15.149:0/2361961974 learned_addr learned my addr 172.21.15.149:0/2361961974 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:34.472 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1e9a00640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40ad9f0 0x7ff1e40ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.471+0000 7ff1e3400640 1 -- 172.21.15.149:0/2361961974 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038928692 0 0) 0x7ff1e40ad560 con 0x7ff1e40b1730 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.472+0000 7ff1e3400640 1 -- 172.21.15.149:0/2361961974 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c80034e0 con 0x7ff1e40b1730 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.472+0000 7ff1e9000640 1 -- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40ad9f0 msgr2=0x7ff1e40ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.472+0000 7ff1e9000640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40ad9f0 0x7ff1e40ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.472+0000 7ff1e9000640 1 -- 172.21.15.149:0/2361961974 >> v1:172.21.15.161:6789/0 conn(0x7ff1e40b1730 legacy=0x7ff1e415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.472+0000 7ff1e9000640 1 -- 172.21.15.149:0/2361961974 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e415e260 con 0x7ff1e40af6b0 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.472+0000 7ff1e9a00640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40ad9f0 0x7ff1e40ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:34.473 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.473+0000 7ff1e9000640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40af6b0 0x7ff1e40afa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009850 tx=0x7ff1d40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e75f2a04976d11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.474 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.473+0000 7ff1e3400640 1 -- 172.21.15.149:0/2361961974 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d402ad00 con 0x7ff1e40af6b0 2024-08-17T02:46:34.474 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.473+0000 7ff1e3400640 1 -- 172.21.15.149:0/2361961974 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d402ae60 con 0x7ff1e40af6b0 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.473+0000 7ff1e3400640 1 -- 172.21.15.149:0/2361961974 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4032670 con 0x7ff1e40af6b0 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.473+0000 7ff1ea400640 1 -- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40af6b0 msgr2=0x7ff1e40afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40af6b0 0x7ff1e40afa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009850 tx=0x7ff1d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 -- 172.21.15.149:0/2361961974 shutdown_connections 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40ad9f0 0x7ff1e40ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 --2- 172.21.15.149:0/2361961974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40af6b0 0x7ff1e40afa80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 -- 172.21.15.149:0/2361961974 >> 172.21.15.149:0/2361961974 conn(0x7ff1e4066d90 msgr2=0x7ff1e4067190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 -- 172.21.15.149:0/2361961974 shutdown_connections 2024-08-17T02:46:34.475 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.474+0000 7ff1ea400640 1 -- 172.21.15.149:0/2361961974 wait complete. 2024-08-17T02:46:34.476 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.476+0000 7ff1ea400640 1 Processor -- start 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.476+0000 7ff1ea400640 1 -- start start 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.476+0000 7ff1ea400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40ad9f0 0x7ff1e41488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1ea400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40af6b0 0x7ff1e40a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1ea400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 0x7ff1e40a7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1ea400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41576a0 con 0x7ff1e40b1730 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1ea400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40a8800 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1ea400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40a7bf0 con 0x7ff1e40af6b0 2024-08-17T02:46:34.480 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1e9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 0x7ff1e40a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1e9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 0x7ff1e40a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39258/0 (socket says 172.21.15.149:39258) 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1e9a00640 1 -- 172.21.15.149:0/4080507249 learned_addr learned my addr 172.21.15.149:0/4080507249 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1e9000640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40ad9f0 0x7ff1e41488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1e3e00640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40af6b0 0x7ff1e40a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.477+0000 7ff1e9000640 1 -- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40af6b0 msgr2=0x7ff1e40a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1e9000640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40af6b0 0x7ff1e40a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1e9000640 1 -- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 msgr2=0x7ff1e40a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1e9000640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 0x7ff1e40a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1e9000640 1 -- 172.21.15.149:0/4080507249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc009a20 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.481 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1e9a00640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 0x7ff1e40a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:34.482 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1e9000640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40ad9f0 0x7ff1e41488e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4031000 tx=0x7ff1d4032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.482 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d403b6e0 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.482 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d403b840 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.482 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.478+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d403b9d0 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.482 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.479+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d4009390 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.482 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.479+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40a81b0 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.483 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.480+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e4071100 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.483 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.481+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7ff1d4039040 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.483 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.482+0000 7ff1dbe00640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff1c0065190 0x7ff1c0067640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.483 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.482+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2507+0+0 (secure 0 0 0) 0x7ff1d4041020 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.483 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.482+0000 7ff1e3e00640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff1c0065190 0x7ff1c0067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.484 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.483+0000 7ff1e3e00640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff1c0065190 0x7ff1c0067640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4159ed0 tx=0x7ff1cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.487 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.487+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff1d40704c0 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.599 INFO:tasks.ceph.osd.2.smithi149.stderr:2024-08-17T02:46:34.598+0000 7f0b80000640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:46:34.604 INFO:tasks.ceph.osd.2.smithi149.stderr:2024-08-17T02:46:34.604+0000 7f0b77400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:34.643 INFO:tasks.ceph.osd.3.smithi149.stderr:2024-08-17T02:46:34.642+0000 7f7842200640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:46:34.648 INFO:tasks.ceph.osd.3.smithi149.stderr:2024-08-17T02:46:34.648+0000 7f7839600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:34.717 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.717+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e40ac9b0 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.718 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.718+0000 7ff1dbe00640 1 -- 172.21.15.149:0/4080507249 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7462 (secure 0 0 0) 0x7ff1d4037020 con 0x7ff1e40ad9f0 2024-08-17T02:46:34.719 INFO:teuthology.misc.health.smithi149.stdout: 2024-08-17T02:46:34.719 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":14,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:33.675526+0000","last_up_change":"2024-08-17T02:46:33.675526+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff1c0065190 msgr2=0x7ff1c0067640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff1c0065190 0x7ff1c0067640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4159ed0 tx=0x7ff1cc009040 comp rx=0 tx=0).stop 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40ad9f0 msgr2=0x7ff1e41488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40ad9f0 0x7ff1e41488e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4031000 tx=0x7ff1d4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 shutdown_connections 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff1c0065190 0x7ff1c0067640 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.721 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e40b1730 0x7ff1e40a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.722 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1e40af6b0 0x7ff1e40a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.722 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 --2- 172.21.15.149:0/4080507249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e40ad9f0 0x7ff1e41488e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.722 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 >> 172.21.15.149:0/4080507249 conn(0x7ff1e4066d90 msgr2=0x7ff1e415a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.722 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 shutdown_connections 2024-08-17T02:46:34.722 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:34.720+0000 7ff1ea400640 1 -- 172.21.15.149:0/4080507249 wait complete. 2024-08-17T02:46:34.733 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-08-17T02:46:39.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:39.447 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:41.541 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:41.680 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.678+0000 7ff4b0e00640 1 Processor -- start 2024-08-17T02:46:41.680 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.678+0000 7ff4b0e00640 1 -- start start 2024-08-17T02:46:41.682 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4b0e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff4ac0c8860 0x7ff4ac0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.682 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4b0e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac0ae640 con 0x7ff4ac140520 2024-08-17T02:46:41.682 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4b0e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac0af4b0 con 0x7ff4ac0c8400 2024-08-17T02:46:41.682 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4b0e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cb6c0 con 0x7ff4ac0c8860 2024-08-17T02:46:41.682 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4aa800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff4ac0c8860 0x7ff4ac0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.682 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4a9e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff4ac140520 0x7ff4ac0adad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50720/0 (socket says 172.21.15.149:50720) 2024-08-17T02:46:41.683 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4a9e00640 1 -- 172.21.15.149:0/3601640279 learned_addr learned my addr 172.21.15.149:0/3601640279 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:41.683 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4a9400640 1 -- 172.21.15.149:0/3601640279 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510960624 0 0) 0x7ff4ac0ae640 con 0x7ff4ac140520 2024-08-17T02:46:41.683 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4aa800640 1 -- 172.21.15.149:0/3601640279 >> v1:172.21.15.161:6789/0 conn(0x7ff4ac0c8400 legacy=0x7ff4ac0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.683 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4aa800640 1 -- 172.21.15.149:0/3601640279 >> v1:172.21.15.149:6789/0 conn(0x7ff4ac140520 legacy=0x7ff4ac0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.683 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.680+0000 7ff4aa800640 1 -- 172.21.15.149:0/3601640279 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0aeb80 con 0x7ff4ac0c8860 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.681+0000 7ff4aa800640 1 --2- 172.21.15.149:0/3601640279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac0c8860 0x7ff4ac0b0050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009de0 tx=0x7ff4a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab06420c239df816 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4a9400640 1 -- 172.21.15.149:0/3601640279 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4007550 con 0x7ff4ac0c8860 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4a9400640 1 -- 172.21.15.149:0/3601640279 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a402d050 con 0x7ff4ac0c8860 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4a9400640 1 -- 172.21.15.149:0/3601640279 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40078e0 con 0x7ff4ac0c8860 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3601640279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac0c8860 msgr2=0x7ff4ac0b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3601640279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac0c8860 0x7ff4ac0b0050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009de0 tx=0x7ff4a4009780 comp rx=0 tx=0).stop 2024-08-17T02:46:41.684 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3601640279 shutdown_connections 2024-08-17T02:46:41.685 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3601640279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac0c8860 0x7ff4ac0b0050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.685 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3601640279 >> 172.21.15.149:0/3601640279 conn(0x7ff4ac067810 msgr2=0x7ff4ac06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.685 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3601640279 shutdown_connections 2024-08-17T02:46:41.685 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.682+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3601640279 wait complete. 2024-08-17T02:46:41.685 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.684+0000 7ff4b0e00640 1 Processor -- start 2024-08-17T02:46:41.685 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.684+0000 7ff4b0e00640 1 -- start start 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4b0e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0c8400 0x7ff4ac14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4b0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0c8860 0x7ff4ac13ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4b0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 0x7ff4ac13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4b0e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac15c330 con 0x7ff4ac140520 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4b0e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac15ba00 con 0x7ff4ac0c8400 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4b0e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac15bce0 con 0x7ff4ac0c8860 2024-08-17T02:46:41.688 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 0x7ff4ac13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 0x7ff4ac13e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55472/0 (socket says 172.21.15.149:55472) 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 -- 172.21.15.149:0/3178300007 learned_addr learned my addr 172.21.15.149:0/3178300007 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4a9e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0c8400 0x7ff4ac14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4a1400640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0c8860 0x7ff4ac13ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 -- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0c8860 msgr2=0x7ff4ac13ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0c8860 0x7ff4ac13ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 -- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0c8400 msgr2=0x7ff4ac14c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0c8400 0x7ff4ac14c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.685+0000 7ff4aa800640 1 -- 172.21.15.149:0/3178300007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009a20 con 0x7ff4ac140520 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.686+0000 7ff4aa800640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 0x7ff4ac13e410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40099f0 tx=0x7ff4a4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.686+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4031c30 con 0x7ff4ac140520 2024-08-17T02:46:41.689 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.686+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4040070 con 0x7ff4ac140520 2024-08-17T02:46:41.690 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.686+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac15bfc0 con 0x7ff4ac140520 2024-08-17T02:46:41.690 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.686+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4045430 con 0x7ff4ac140520 2024-08-17T02:46:41.690 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.686+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac15cb60 con 0x7ff4ac140520 2024-08-17T02:46:41.690 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.687+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac064a50 con 0x7ff4ac140520 2024-08-17T02:46:41.691 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.688+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff4a4042030 con 0x7ff4ac140520 2024-08-17T02:46:41.691 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.689+0000 7ff4a2000640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff488065150 0x7ff488067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.691 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.689+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff4a40a3b70 con 0x7ff4ac140520 2024-08-17T02:46:41.691 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.689+0000 7ff4a9e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff488065150 0x7ff488067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.691 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.690+0000 7ff4a9e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff488065150 0x7ff488067600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0011e0 tx=0x7ff49c007c80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.695 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.694+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff4a4071f90 con 0x7ff4ac140520 2024-08-17T02:46:41.866 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.864+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4ac069e50 con 0x7ff4ac140520 2024-08-17T02:46:41.866 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.865+0000 7ff4a2000640 1 -- 172.21.15.149:0/3178300007 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7ff4a40755b0 con 0x7ff4ac140520 2024-08-17T02:46:41.867 INFO:teuthology.misc.health.smithi149.stdout: 2024-08-17T02:46:41.867 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":18,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:37.984786+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:41.869 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff488065150 msgr2=0x7ff488067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.869 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff488065150 0x7ff488067600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0011e0 tx=0x7ff49c007c80 comp rx=0 tx=0).stop 2024-08-17T02:46:41.869 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 msgr2=0x7ff4ac13e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 0x7ff4ac13e410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40099f0 tx=0x7ff4a4037000 comp rx=0 tx=0).stop 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 shutdown_connections 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff488065150 0x7ff488067600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4ac140520 0x7ff4ac13e410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0c8860 0x7ff4ac13ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 --2- 172.21.15.149:0/3178300007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0c8400 0x7ff4ac14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.867+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 >> 172.21.15.149:0/3178300007 conn(0x7ff4ac067810 msgr2=0x7ff4ac068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.868+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 shutdown_connections 2024-08-17T02:46:41.870 INFO:teuthology.misc.health.smithi149.stderr:2024-08-17T02:46:41.868+0000 7ff4b0e00640 1 -- 172.21.15.149:0/3178300007 wait complete. 2024-08-17T02:46:41.882 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:46:41.882 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:46:41.883 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:46:41.883 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:46:41.886 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:46:41.887 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:46:41.887 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:46:41.890 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:46:41.890 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:46:41.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:46:41.895 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:46:41.895 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:46:41.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:46:41.899 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:46:41.899 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:46:41.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:42.013 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2024-08-17T02:46:42.017 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2024-08-17T02:46:42.029 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2024-08-17T02:46:42.029 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2024-08-17T02:46:42.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.059+0000 7ff2a2800640 1 Processor -- start 2024-08-17T02:46:42.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.059+0000 7ff2a2800640 1 -- start start 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.060+0000 7ff2a2800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 0x7ff29c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.060+0000 7ff2a2800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 0x7ff29c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.060+0000 7ff2a2800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c156670 con 0x7ff29c155df0 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.060+0000 7ff2a2800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0b0350 con 0x7ff29c06df00 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.060+0000 7ff2a2800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c06e5e0 con 0x7ff29c155a20 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.060+0000 7ff29b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 0x7ff29c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 0x7ff29c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 0x7ff29c0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:46712/0 (socket says 172.21.15.149:46712) 2024-08-17T02:46:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 0x7ff29c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:49128/0 (socket says 172.21.15.149:49128) 2024-08-17T02:46:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29be00640 1 -- 172.21.15.149:0/3182681672 learned_addr learned my addr 172.21.15.149:0/3182681672 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29aa00640 1 --1- 172.21.15.149:0/3182681672 >> v1:172.21.15.161:6789/0 conn(0x7ff29c155df0 0x7ff29c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:59876/0 (socket says 172.21.15.149:59876) 2024-08-17T02:46:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29b400640 1 -- 172.21.15.149:0/3182681672 >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 msgr2=0x7ff29c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29b400640 1 --2- 172.21.15.149:0/3182681672 >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 0x7ff29c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29b400640 1 -- 172.21.15.149:0/3182681672 >> v1:172.21.15.161:6789/0 conn(0x7ff29c155df0 legacy=0x7ff29c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29b400640 1 -- 172.21.15.149:0/3182681672 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c06e8c0 con 0x7ff29c155a20 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29be00640 1 --2- 172.21.15.149:0/3182681672 >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 0x7ff29c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.061+0000 7ff29a000640 1 -- 172.21.15.149:0/3182681672 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913674613 0 0) 0x7ff29c156670 con 0x7ff29c155df0 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.062+0000 7ff29b400640 1 --2- 172.21.15.149:0/3182681672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 0x7ff29c0adf10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009850 tx=0x7ff28c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7265e06fb34dac51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.062+0000 7ff29a000640 1 -- 172.21.15.149:0/3182681672 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c02ad80 con 0x7ff29c155a20 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.062+0000 7ff29a000640 1 -- 172.21.15.149:0/3182681672 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c032440 con 0x7ff29c155a20 2024-08-17T02:46:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.062+0000 7ff29a000640 1 -- 172.21.15.149:0/3182681672 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0327e0 con 0x7ff29c155a20 2024-08-17T02:46:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 -- 172.21.15.149:0/3182681672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 msgr2=0x7ff29c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 --2- 172.21.15.149:0/3182681672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 0x7ff29c0adf10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009850 tx=0x7ff28c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 -- 172.21.15.149:0/3182681672 shutdown_connections 2024-08-17T02:46:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 --2- 172.21.15.149:0/3182681672 >> v2:172.21.15.161:3300/0 conn(0x7ff29c06df00 0x7ff29c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 --2- 172.21.15.149:0/3182681672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c155a20 0x7ff29c0adf10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 -- 172.21.15.149:0/3182681672 >> 172.21.15.149:0/3182681672 conn(0x7ff29c0cb9b0 msgr2=0x7ff29c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 -- 172.21.15.149:0/3182681672 shutdown_connections 2024-08-17T02:46:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.063+0000 7ff2a2800640 1 -- 172.21.15.149:0/3182681672 wait complete. 2024-08-17T02:46:42.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.064+0000 7ff2a2800640 1 Processor -- start 2024-08-17T02:46:42.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.064+0000 7ff2a2800640 1 -- start start 2024-08-17T02:46:42.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.065+0000 7ff2a2800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c06df00 0x7ff29c16a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.065+0000 7ff2a2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 0x7ff29c1670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.065+0000 7ff2a2800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c155df0 0x7ff29c16bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.065+0000 7ff2a2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c16aba0 con 0x7ff29c155a20 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.065+0000 7ff2a2800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c16ae70 con 0x7ff29c155df0 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.065+0000 7ff2a2800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c16b150 con 0x7ff29c06df00 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 0x7ff29c1670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 0x7ff29c1670d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55494/0 (socket says 172.21.15.149:55494) 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 -- 172.21.15.149:0/4089084869 learned_addr learned my addr 172.21.15.149:0/4089084869 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29b400640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c06df00 0x7ff29c16a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29be00640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c155df0 0x7ff29c16bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 -- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c06df00 msgr2=0x7ff29c16a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c06df00 0x7ff29c16a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 -- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c155df0 msgr2=0x7ff29c16bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c155df0 0x7ff29c16bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 -- 172.21.15.149:0/4089084869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009ae0 con 0x7ff29c155a20 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29be00640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c155df0 0x7ff29c16bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.066+0000 7ff29aa00640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 0x7ff29c1670d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c5b0 tx=0x7ff288007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.067+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288007300 con 0x7ff29c155a20 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.067+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2880074a0 con 0x7ff29c155a20 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.067+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c009390 con 0x7ff29c155a20 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.067+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880049f0 con 0x7ff29c155a20 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.067+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c16b710 con 0x7ff29c155a20 2024-08-17T02:46:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.068+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c064db0 con 0x7ff29c155a20 2024-08-17T02:46:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.069+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff28801c3b0 con 0x7ff29c155a20 2024-08-17T02:46:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.069+0000 7ff292a00640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff27c065150 0x7ff27c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.070+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff2880814b0 con 0x7ff29c155a20 2024-08-17T02:46:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.070+0000 7ff29b400640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff27c065150 0x7ff27c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.070+0000 7ff29b400640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff27c065150 0x7ff27c067600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff28c034000 tx=0x7ff28c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.074+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff28804ce40 con 0x7ff29c155a20 2024-08-17T02:46:42.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.246+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff29c0af210 con 0x7ff29c155a20 2024-08-17T02:46:42.249 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.247+0000 7ff292a00640 1 -- 172.21.15.149:0/4089084869 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7ff28804f8d0 con 0x7ff29c155a20 2024-08-17T02:46:42.249 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:42.249 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":18,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:37.984786+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff27c065150 msgr2=0x7ff27c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff27c065150 0x7ff27c067600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff28c034000 tx=0x7ff28c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 msgr2=0x7ff29c1670d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 0x7ff29c1670d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c5b0 tx=0x7ff288007f20 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 shutdown_connections 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff27c065150 0x7ff27c067600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c155df0 0x7ff29c16bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff29c155a20 0x7ff29c1670d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 --2- 172.21.15.149:0/4089084869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c06df00 0x7ff29c16a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.249+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 >> 172.21.15.149:0/4089084869 conn(0x7ff29c0cb9b0 msgr2=0x7ff29c069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.250+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 shutdown_connections 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.250+0000 7ff2a2800640 1 -- 172.21.15.149:0/4089084869 wait complete. 2024-08-17T02:46:42.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:46:42.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:42.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.416+0000 7f4fe3200640 1 Processor -- start 2024-08-17T02:46:42.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.417+0000 7f4fe3200640 1 -- start start 2024-08-17T02:46:42.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe40b2300 con 0x7f4fe40cee50 2024-08-17T02:46:42.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe3200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe40b1710 con 0x7f4fe40b3080 2024-08-17T02:46:42.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40b19d0 con 0x7f4fe406ef90 2024-08-17T02:46:42.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe1e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4fe40cee50 0x7f4fe40b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50732/0 (socket says 172.21.15.149:50732) 2024-08-17T02:46:42.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe1e00640 1 -- 172.21.15.149:0/391838468 learned_addr learned my addr 172.21.15.149:0/391838468 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:42.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe1400640 1 --2- 172.21.15.149:0/391838468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882113105 0 0) 0x7f4fe40b2300 con 0x7f4fe40cee50 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.418+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc80034e0 con 0x7f4fe40cee50 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.419+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799443949 0 0) 0x7f4fe40b1710 con 0x7f4fe40b3080 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.419+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe40b2300 con 0x7f4fe40b3080 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.419+0000 7f4fe1400640 1 -- 172.21.15.149:0/391838468 >> v1:172.21.15.161:6789/0 conn(0x7f4fe40b3080 legacy=0x7f4fe4099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.419+0000 7f4fe1400640 1 -- 172.21.15.149:0/391838468 >> v1:172.21.15.149:6789/0 conn(0x7f4fe40cee50 legacy=0x7f4fe40b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.419+0000 7f4fe1400640 1 -- 172.21.15.149:0/391838468 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40b1cb0 con 0x7f4fe406ef90 2024-08-17T02:46:42.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.420+0000 7f4fe1400640 1 --2- 172.21.15.149:0/391838468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40b54e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009880 tx=0x7f4fd00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e018dbfb7fcfc67 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.420+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd002aea0 con 0x7f4fe406ef90 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.420+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0032440 con 0x7f4fe406ef90 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.420+0000 7f4fe0a00640 1 -- 172.21.15.149:0/391838468 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00327c0 con 0x7f4fe406ef90 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 -- 172.21.15.149:0/391838468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 msgr2=0x7f4fe40b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 --2- 172.21.15.149:0/391838468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40b54e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009880 tx=0x7f4fd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 -- 172.21.15.149:0/391838468 shutdown_connections 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 --2- 172.21.15.149:0/391838468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40b54e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 -- 172.21.15.149:0/391838468 >> 172.21.15.149:0/391838468 conn(0x7f4fe406eb90 msgr2=0x7f4fe40cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 -- 172.21.15.149:0/391838468 shutdown_connections 2024-08-17T02:46:42.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.421+0000 7f4fe3200640 1 -- 172.21.15.149:0/391838468 wait complete. 2024-08-17T02:46:42.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.422+0000 7f4fe3200640 1 Processor -- start 2024-08-17T02:46:42.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.422+0000 7f4fe3200640 1 -- start start 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe3200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe40b3080 0x7f4fe4068360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 0x7f4fe414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40ad0f0 con 0x7f4fe40cee50 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe3200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40ad3d0 con 0x7f4fe40b3080 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40ad6b0 con 0x7f4fe406ef90 2024-08-17T02:46:42.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 0x7f4fe414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 0x7f4fe414cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55502/0 (socket says 172.21.15.149:55502) 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.423+0000 7f4fe2800640 1 -- 172.21.15.149:0/2851678508 learned_addr learned my addr 172.21.15.149:0/2851678508 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe1400640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe40b3080 0x7f4fe4068360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe1e00640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe2800640 1 -- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 msgr2=0x7f4fe40ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe2800640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe2800640 1 -- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe40b3080 msgr2=0x7f4fe4068360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe2800640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe40b3080 0x7f4fe4068360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe2800640 1 -- 172.21.15.149:0/2851678508 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009390 con 0x7f4fe40cee50 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe1400640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe40b3080 0x7f4fe4068360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe1e00640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe2800640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 0x7f4fe414cba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c840 tx=0x7f4fdc002660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00ce30 con 0x7f4fe40cee50 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc00a7f0 con 0x7f4fe40cee50 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00ac30 con 0x7f4fe40cee50 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.424+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40ad990 con 0x7f4fe40cee50 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.425+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe40688a0 con 0x7f4fe40cee50 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.426+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe40ade90 con 0x7f4fe40cee50 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.426+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4fdc012630 con 0x7f4fe40cee50 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.427+0000 7f4fd9600640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.427+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4fdc082550 con 0x7f4fe40cee50 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.428+0000 7f4fe1e00640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.428+0000 7f4fe1e00640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007fd0 tx=0x7f4fd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.431+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4fdc0508c0 con 0x7f4fe40cee50 2024-08-17T02:46:42.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.601+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fe4068af0 con 0x7f4fe40cee50 2024-08-17T02:46:42.603 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.601+0000 7f4fd9600640 1 -- 172.21.15.149:0/2851678508 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fdc016020 con 0x7f4fe40cee50 2024-08-17T02:46:42.603 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:46:42.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 msgr2=0x7f4fc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007fd0 tx=0x7f4fd4009040 comp rx=0 tx=0).stop 2024-08-17T02:46:42.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 msgr2=0x7f4fe414cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 0x7f4fe414cba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c840 tx=0x7f4fdc002660 comp rx=0 tx=0).stop 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 shutdown_connections 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe40cee50 0x7f4fe414cba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe40b3080 0x7f4fe4068360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 --2- 172.21.15.149:0/2851678508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe406ef90 0x7f4fe40ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.603+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 >> 172.21.15.149:0/2851678508 conn(0x7f4fe406eb90 msgr2=0x7f4fe40cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.604+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 shutdown_connections 2024-08-17T02:46:42.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.604+0000 7f4fe3200640 1 -- 172.21.15.149:0/2851678508 wait complete. 2024-08-17T02:46:42.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:42.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.766+0000 7fbc72c00640 1 Processor -- start 2024-08-17T02:46:42.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.766+0000 7fbc72c00640 1 -- start start 2024-08-17T02:46:42.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.767+0000 7fbc72c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc6c1401b0 0x7fbc6c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.767+0000 7fbc72c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0caa80 con 0x7fbc6c0b1440 2024-08-17T02:46:42.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.767+0000 7fbc72c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0c9e70 con 0x7fbc6c140580 2024-08-17T02:46:42.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.767+0000 7fbc72c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0cb450 con 0x7fbc6c1401b0 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc70c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbc6c0b1440 0x7fbc6c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50736/0 (socket says 172.21.15.149:50736) 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc70c00640 1 -- 172.21.15.149:0/3523948788 learned_addr learned my addr 172.21.15.149:0/3523948788 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6be00640 1 --2- 172.21.15.149:0/3523948788 >> v2:172.21.15.161:3300/0 conn(0x7fbc6c1401b0 0x7fbc6c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6aa00640 1 -- 172.21.15.149:0/3523948788 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929419319 0 0) 0x7fbc6c0caa80 con 0x7fbc6c0b1440 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6aa00640 1 -- 172.21.15.149:0/3523948788 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc500034e0 con 0x7fbc6c0b1440 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6be00640 1 -- 172.21.15.149:0/3523948788 >> v1:172.21.15.161:6789/0 conn(0x7fbc6c140580 legacy=0x7fbc6c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6aa00640 1 -- 172.21.15.149:0/3523948788 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160000447 0 0) 0x7fbc6c0c9e70 con 0x7fbc6c140580 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6be00640 1 -- 172.21.15.149:0/3523948788 >> v1:172.21.15.149:6789/0 conn(0x7fbc6c0b1440 legacy=0x7fbc6c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.768+0000 7fbc6be00640 1 -- 172.21.15.149:0/3523948788 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0ca150 con 0x7fbc6c1401b0 2024-08-17T02:46:42.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.769+0000 7fbc6be00640 1 --2- 172.21.15.149:0/3523948788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c1401b0 0x7fbc6c0caf10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009850 tx=0x7fbc5c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99758c4e82c92325 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc6aa00640 1 -- 172.21.15.149:0/3523948788 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c02ad90 con 0x7fbc6c1401b0 2024-08-17T02:46:42.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc6aa00640 1 -- 172.21.15.149:0/3523948788 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c032440 con 0x7fbc6c1401b0 2024-08-17T02:46:42.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc6aa00640 1 -- 172.21.15.149:0/3523948788 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c0327c0 con 0x7fbc6c1401b0 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 -- 172.21.15.149:0/3523948788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c1401b0 msgr2=0x7fbc6c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 --2- 172.21.15.149:0/3523948788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c1401b0 0x7fbc6c0caf10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009850 tx=0x7fbc5c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 -- 172.21.15.149:0/3523948788 shutdown_connections 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 --2- 172.21.15.149:0/3523948788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c1401b0 0x7fbc6c0caf10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 -- 172.21.15.149:0/3523948788 >> 172.21.15.149:0/3523948788 conn(0x7fbc6c0cb9b0 msgr2=0x7fbc6c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 -- 172.21.15.149:0/3523948788 shutdown_connections 2024-08-17T02:46:42.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.770+0000 7fbc72c00640 1 -- 172.21.15.149:0/3523948788 wait complete. 2024-08-17T02:46:42.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.772+0000 7fbc72c00640 1 Processor -- start 2024-08-17T02:46:42.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.772+0000 7fbc72c00640 1 -- start start 2024-08-17T02:46:42.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc72c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c0b1440 0x7fbc6c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc72c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc6c1401b0 0x7fbc6c169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc72c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 0x7fbc6c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc72c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c156bf0 con 0x7fbc6c140580 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc72c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c16a1f0 con 0x7fbc6c0b1440 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc72c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c169c30 con 0x7fbc6c1401b0 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 0x7fbc6c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 0x7fbc6c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55512/0 (socket says 172.21.15.149:55512) 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 -- 172.21.15.149:0/46078579 learned_addr learned my addr 172.21.15.149:0/46078579 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c0b1440 0x7fbc6c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc6b400640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc6c1401b0 0x7fbc6c169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 -- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc6c1401b0 msgr2=0x7fbc6c169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc6c1401b0 0x7fbc6c169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 -- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c0b1440 msgr2=0x7fbc6c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c0b1440 0x7fbc6c1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.773+0000 7fbc70c00640 1 -- 172.21.15.149:0/46078579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c009390 con 0x7fbc6c140580 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.774+0000 7fbc70c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 0x7fbc6c1593b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400cc40 tx=0x7fbc64001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.774+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400ce00 con 0x7fbc6c140580 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.774+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6400a850 con 0x7fbc6c140580 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.774+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400ac10 con 0x7fbc6c140580 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.774+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c169f10 con 0x7fbc6c140580 2024-08-17T02:46:42.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.774+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c0aef30 con 0x7fbc6c140580 2024-08-17T02:46:42.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.775+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c064db0 con 0x7fbc6c140580 2024-08-17T02:46:42.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.776+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc64007300 con 0x7fbc6c140580 2024-08-17T02:46:42.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.777+0000 7fbc63400640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc4c065150 0x7fbc4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.777+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbc64082190 con 0x7fbc6c140580 2024-08-17T02:46:42.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.777+0000 7fbc6be00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc4c065150 0x7fbc4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.777+0000 7fbc6be00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc4c065150 0x7fbc4c067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c034000 tx=0x7fbc5c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.782 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.781+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc64050630 con 0x7fbc6c140580 2024-08-17T02:46:42.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.991+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc6c0a54d0 con 0x7fbc6c140580 2024-08-17T02:46:42.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.991+0000 7fbc63400640 1 -- 172.21.15.149:0/46078579 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fbc64053c50 con 0x7fbc6c140580 2024-08-17T02:46:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:42.993 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:46:42.993 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 2 2024-08-17T02:46:42.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.993+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc4c065150 msgr2=0x7fbc4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.993+0000 7fbc72c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc4c065150 0x7fbc4c067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c034000 tx=0x7fbc5c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:42.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.993+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 msgr2=0x7fbc6c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.993+0000 7fbc72c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 0x7fbc6c1593b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400cc40 tx=0x7fbc64001a00 comp rx=0 tx=0).stop 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 shutdown_connections 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc4c065150 0x7fbc4c067600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c140580 0x7fbc6c1593b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc6c1401b0 0x7fbc6c169200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 --2- 172.21.15.149:0/46078579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc6c0b1440 0x7fbc6c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 >> 172.21.15.149:0/46078579 conn(0x7fbc6c0cb9b0 msgr2=0x7fbc6c0ad420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 shutdown_connections 2024-08-17T02:46:42.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:42.994+0000 7fbc72c00640 1 -- 172.21.15.149:0/46078579 wait complete. 2024-08-17T02:46:45.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:45.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.169+0000 7f03ae800640 1 Processor -- start 2024-08-17T02:46:45.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.169+0000 7f03ae800640 1 -- start start 2024-08-17T02:46:45.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03ae800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03ae800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03a80acf10 0x7f03a806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03ae800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80ae250 con 0x7f03a815ccc0 2024-08-17T02:46:45.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03ae800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a806e820 con 0x7f03a80acf10 2024-08-17T02:46:45.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03ae800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80ad640 con 0x7f03a806d7a0 2024-08-17T02:46:45.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03ad400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03aca00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03a80acf10 0x7f03a806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03aca00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03a80acf10 0x7f03a806e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:46750/0 (socket says 172.21.15.149:46750) 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.171+0000 7f03aca00640 1 -- 172.21.15.149:0/4223129550 learned_addr learned my addr 172.21.15.149:0/4223129550 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.172+0000 7f03aca00640 1 -- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 msgr2=0x7f03a806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.172+0000 7f03aca00640 1 --2- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.172+0000 7f03aca00640 1 -- 172.21.15.149:0/4223129550 >> v1:172.21.15.161:6789/0 conn(0x7f03a815ccc0 legacy=0x7f03a815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.172+0000 7f03aca00640 1 -- 172.21.15.149:0/4223129550 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80ad920 con 0x7f03a80acf10 2024-08-17T02:46:45.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.172+0000 7f03aca00640 1 --2- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a80acf10 0x7f03a806e2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0394009940 tx=0x7f03940091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f4f373dd647ab8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03a7e00640 1 -- 172.21.15.149:0/4223129550 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039402adb0 con 0x7f03a80acf10 2024-08-17T02:46:45.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03a7e00640 1 -- 172.21.15.149:0/4223129550 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394032440 con 0x7f03a80acf10 2024-08-17T02:46:45.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03a7e00640 1 -- 172.21.15.149:0/4223129550 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394032820 con 0x7f03a80acf10 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03ae800640 1 -- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a80acf10 msgr2=0x7f03a806e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03ae800640 1 --2- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a80acf10 0x7f03a806e2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0394009940 tx=0x7f03940091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03ae800640 1 -- 172.21.15.149:0/4223129550 shutdown_connections 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03ae800640 1 --2- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a80acf10 0x7f03a806e2e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03ae800640 1 --2- 172.21.15.149:0/4223129550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.173+0000 7f03ae800640 1 -- 172.21.15.149:0/4223129550 >> 172.21.15.149:0/4223129550 conn(0x7f03a8067750 msgr2=0x7f03a80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.174+0000 7f03ae800640 1 -- 172.21.15.149:0/4223129550 shutdown_connections 2024-08-17T02:46:45.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.174+0000 7f03ae800640 1 -- 172.21.15.149:0/4223129550 wait complete. 2024-08-17T02:46:45.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.175+0000 7f03ae800640 1 Processor -- start 2024-08-17T02:46:45.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.175+0000 7f03ae800640 1 -- start start 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ae800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a81517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ae800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 0x7f03a815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ae800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a815ccc0 0x7f03a8155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ae800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8151340 con 0x7f03a80acf10 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ae800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c7a70 con 0x7f03a815ccc0 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ae800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c7d50 con 0x7f03a806d7a0 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03aca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 0x7f03a815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03aca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 0x7f03a815c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55520/0 (socket says 172.21.15.149:55520) 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03aca00640 1 -- 172.21.15.149:0/1547565152 learned_addr learned my addr 172.21.15.149:0/1547565152 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:45.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ad400640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a81517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.176+0000 7f03ade00640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a815ccc0 0x7f03a8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03aca00640 1 -- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 msgr2=0x7f03a81517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03aca00640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a81517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03aca00640 1 -- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a815ccc0 msgr2=0x7f03a8155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03aca00640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a815ccc0 0x7f03a8155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03aca00640 1 -- 172.21.15.149:0/1547565152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009450 con 0x7f03a80acf10 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03aca00640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 0x7f03a815c310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0394035040 tx=0x7f0394032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394031bb0 con 0x7f03a80acf10 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394031d70 con 0x7f03a80acf10 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039403d670 con 0x7f03a80acf10 2024-08-17T02:46:45.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a8150cf0 con 0x7f03a80acf10 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.177+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a80cae00 con 0x7f03a80acf10 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.178+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a81514f0 con 0x7f03a80acf10 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.179+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0394039040 con 0x7f03a80acf10 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.180+0000 7f03a4c00640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0388065150 0x7f0388067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.180+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f03940a1ef0 con 0x7f03a80acf10 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.180+0000 7f03ad400640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0388065150 0x7f0388067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.181+0000 7f03ad400640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0388065150 0x7f0388067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f039c009d20 tx=0x7f039c0090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.185+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f03a81514f0 con 0x7f03a80acf10 2024-08-17T02:46:45.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.392+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03a8071050 con 0x7f03a80acf10 2024-08-17T02:46:45.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.392+0000 7f03a4c00640 1 -- 172.21.15.149:0/1547565152 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f0394042de0 con 0x7f03a80acf10 2024-08-17T02:46:45.394 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:45.394 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:46:45.394 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 3 2024-08-17T02:46:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0388065150 msgr2=0x7f0388067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0388065150 0x7f0388067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f039c009d20 tx=0x7f039c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 msgr2=0x7f03a815c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 0x7f03a815c310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0394035040 tx=0x7f0394032000 comp rx=0 tx=0).stop 2024-08-17T02:46:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 shutdown_connections 2024-08-17T02:46:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0388065150 0x7f0388067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03a815ccc0 0x7f03a8155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a80acf10 0x7f03a815c310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 --2- 172.21.15.149:0/1547565152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03a806d7a0 0x7f03a81517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 >> 172.21.15.149:0/1547565152 conn(0x7f03a8067750 msgr2=0x7f03a80af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.394+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 shutdown_connections 2024-08-17T02:46:45.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.395+0000 7f03ae800640 1 -- 172.21.15.149:0/1547565152 wait complete. 2024-08-17T02:46:45.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:45.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.562+0000 7f7b6f000640 1 Processor -- start 2024-08-17T02:46:45.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.563+0000 7f7b6f000640 1 -- start start 2024-08-17T02:46:45.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b6f000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b680b1120 0x7f7b680aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b6f000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680d0ab0 con 0x7f7b680b3370 2024-08-17T02:46:45.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b6f000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680b00c0 con 0x7f7b680ada10 2024-08-17T02:46:45.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b6f000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b680af330 con 0x7f7b680b1120 2024-08-17T02:46:45.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b67400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b680b1120 0x7f7b680aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b67400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b680b1120 0x7f7b680aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55526/0 (socket says 172.21.15.149:55526) 2024-08-17T02:46:45.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b6d000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7b680b3370 0x7f7b681629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50740/0 (socket says 172.21.15.149:50740) 2024-08-17T02:46:45.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.564+0000 7f7b67400640 1 -- 172.21.15.149:0/1684241574 learned_addr learned my addr 172.21.15.149:0/1684241574 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:45.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.565+0000 7f7b67400640 1 -- 172.21.15.149:0/1684241574 >> v1:172.21.15.161:6789/0 conn(0x7f7b680ada10 legacy=0x7f7b680b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.565+0000 7f7b67400640 1 -- 172.21.15.149:0/1684241574 >> v1:172.21.15.149:6789/0 conn(0x7f7b680b3370 legacy=0x7f7b681629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.565+0000 7f7b67400640 1 -- 172.21.15.149:0/1684241574 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680b0360 con 0x7f7b680b1120 2024-08-17T02:46:45.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.565+0000 7f7b66a00640 1 -- 172.21.15.149:0/1684241574 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276038269 0 0) 0x7f7b680d0ab0 con 0x7f7b680b3370 2024-08-17T02:46:45.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b67400640 1 --2- 172.21.15.149:0/1684241574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680aedf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009910 tx=0x7f7b540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392292cd351e55cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b66a00640 1 -- 172.21.15.149:0/1684241574 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54032440 con 0x7f7b680b1120 2024-08-17T02:46:45.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b66a00640 1 -- 172.21.15.149:0/1684241574 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b540325a0 con 0x7f7b680b1120 2024-08-17T02:46:45.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b66a00640 1 -- 172.21.15.149:0/1684241574 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54032940 con 0x7f7b680b1120 2024-08-17T02:46:45.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b6f000640 1 -- 172.21.15.149:0/1684241574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 msgr2=0x7f7b680aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b6f000640 1 --2- 172.21.15.149:0/1684241574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680aedf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009910 tx=0x7f7b540091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b6f000640 1 -- 172.21.15.149:0/1684241574 shutdown_connections 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b6f000640 1 --2- 172.21.15.149:0/1684241574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680aedf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.566+0000 7f7b6f000640 1 -- 172.21.15.149:0/1684241574 >> 172.21.15.149:0/1684241574 conn(0x7f7b680cfdf0 msgr2=0x7f7b680d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.567+0000 7f7b6f000640 1 -- 172.21.15.149:0/1684241574 shutdown_connections 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.567+0000 7f7b6f000640 1 -- 172.21.15.149:0/1684241574 wait complete. 2024-08-17T02:46:45.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.568+0000 7f7b6f000640 1 Processor -- start 2024-08-17T02:46:45.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.568+0000 7f7b6f000640 1 -- start start 2024-08-17T02:46:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6f000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b680ada10 0x7f7b68150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6f000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b680b3370 0x7f7b680cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680ccb50 con 0x7f7b680b1120 2024-08-17T02:46:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6f000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68154310 con 0x7f7b680b3370 2024-08-17T02:46:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6f000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680cc220 con 0x7f7b680ada10 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55530/0 (socket says 172.21.15.149:55530) 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 -- 172.21.15.149:0/2906985715 learned_addr learned my addr 172.21.15.149:0/2906985715 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b6d000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b680b3370 0x7f7b680cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67e00640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b680ada10 0x7f7b68150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 -- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b680ada10 msgr2=0x7f7b68150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b680ada10 0x7f7b68150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 -- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b680b3370 msgr2=0x7f7b680cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.569+0000 7f7b67400640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b680b3370 0x7f7b680cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b67400640 1 -- 172.21.15.149:0/2906985715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54009450 con 0x7f7b680b1120 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b6d000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b680b3370 0x7f7b680cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b67400640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680cd9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009910 tx=0x7f7b54032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54031b30 con 0x7f7b680b1120 2024-08-17T02:46:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54031c90 con 0x7f7b680b1120 2024-08-17T02:46:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b680cc500 con 0x7f7b680b1120 2024-08-17T02:46:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5403b650 con 0x7f7b680b1120 2024-08-17T02:46:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.570+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68150dc0 con 0x7f7b680b1120 2024-08-17T02:46:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.571+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b680cccc0 con 0x7f7b680b1120 2024-08-17T02:46:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.572+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7b54039040 con 0x7f7b680b1120 2024-08-17T02:46:45.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.573+0000 7f7b5f400640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7b48065180 0x7f7b48067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.573+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7b540a20f0 con 0x7f7b680b1120 2024-08-17T02:46:45.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.573+0000 7f7b67e00640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7b48065180 0x7f7b48067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.573+0000 7f7b67e00640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7b48065180 0x7f7b48067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b580037c0 tx=0x7f7b58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.577+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7b54070460 con 0x7f7b680b1120 2024-08-17T02:46:45.752 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.751+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b68064db0 con 0x7f7b680b1120 2024-08-17T02:46:45.754 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.752+0000 7f7b5f400640 1 -- 172.21.15.149:0/2906985715 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f7b54073a80 con 0x7f7b680b1120 2024-08-17T02:46:45.754 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:45.754 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":18,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:37.984786+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7b48065180 msgr2=0x7f7b48067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7b48065180 0x7f7b48067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b580037c0 tx=0x7f7b58009040 comp rx=0 tx=0).stop 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 msgr2=0x7f7b680cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680cd9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009910 tx=0x7f7b54032000 comp rx=0 tx=0).stop 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 shutdown_connections 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7b48065180 0x7f7b48067630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b680b3370 0x7f7b680cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b680b1120 0x7f7b680cd9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 --2- 172.21.15.149:0/2906985715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b680ada10 0x7f7b68150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 >> 172.21.15.149:0/2906985715 conn(0x7f7b680cfdf0 msgr2=0x7f7b680d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 shutdown_connections 2024-08-17T02:46:45.756 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.754+0000 7f7b6f000640 1 -- 172.21.15.149:0/2906985715 wait complete. 2024-08-17T02:46:45.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:46:45.772 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.920+0000 7f40b3e00640 1 Processor -- start 2024-08-17T02:46:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.920+0000 7f40b3e00640 1 -- start start 2024-08-17T02:46:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f40b40c7940 0x7f40b40c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40b40afbe0 0x7f40b40b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40b05a0 con 0x7f40b40afbe0 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b4159a60 con 0x7f40b40c7940 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4158bb0 con 0x7f40b4154ce0 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40b40afbe0 0x7f40b40b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40b40afbe0 0x7f40b40b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55542/0 (socket says 172.21.15.149:55542) 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 -- 172.21.15.149:0/1771782260 learned_addr learned my addr 172.21.15.149:0/1771782260 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40aa000640 1 --2- 172.21.15.149:0/1771782260 >> v2:172.21.15.161:3300/0 conn(0x7f40b40c7940 0x7f40b40c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b2a00640 1 --2- 172.21.15.149:0/1771782260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 -- 172.21.15.149:0/1771782260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 msgr2=0x7f40b41550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 --2- 172.21.15.149:0/1771782260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b41550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 -- 172.21.15.149:0/1771782260 >> v2:172.21.15.161:3300/0 conn(0x7f40b40c7940 msgr2=0x7f40b40c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 --2- 172.21.15.149:0/1771782260 >> v2:172.21.15.161:3300/0 conn(0x7f40b40c7940 0x7f40b40c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.922+0000 7f40b3400640 1 -- 172.21.15.149:0/1771782260 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4158e50 con 0x7f40b40afbe0 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.923+0000 7f40b3400640 1 --2- 172.21.15.149:0/1771782260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b40b0060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40b406bb00 tx=0x7f40ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b852039c3f90eaff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b2000640 1 -- 172.21.15.149:0/1771782260 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac031400 con 0x7f40b40afbe0 2024-08-17T02:46:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b2000640 1 -- 172.21.15.149:0/1771782260 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac02d050 con 0x7f40b40afbe0 2024-08-17T02:46:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b2000640 1 -- 172.21.15.149:0/1771782260 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0317d0 con 0x7f40b40afbe0 2024-08-17T02:46:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 -- 172.21.15.149:0/1771782260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 msgr2=0x7f40b40b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 --2- 172.21.15.149:0/1771782260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b40b0060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40b406bb00 tx=0x7f40ac009840 comp rx=0 tx=0).stop 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 -- 172.21.15.149:0/1771782260 shutdown_connections 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 --2- 172.21.15.149:0/1771782260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b40b0060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 --2- 172.21.15.149:0/1771782260 >> v2:172.21.15.161:3300/0 conn(0x7f40b40c7940 0x7f40b40c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 --2- 172.21.15.149:0/1771782260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 -- 172.21.15.149:0/1771782260 >> 172.21.15.149:0/1771782260 conn(0x7f40b4067750 msgr2=0x7f40b406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 -- 172.21.15.149:0/1771782260 shutdown_connections 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.924+0000 7f40b3e00640 1 -- 172.21.15.149:0/1771782260 wait complete. 2024-08-17T02:46:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.926+0000 7f40b3e00640 1 Processor -- start 2024-08-17T02:46:45.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.926+0000 7f40b3e00640 1 -- start start 2024-08-17T02:46:45.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b4143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40c7940 0x7f40b41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b416bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4150000 con 0x7f40b40afbe0 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4157920 con 0x7f40b40c7940 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4157c00 con 0x7f40b4154ce0 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b4143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b4143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55546/0 (socket says 172.21.15.149:55546) 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 -- 172.21.15.149:0/2634359147 learned_addr learned my addr 172.21.15.149:0/2634359147 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b3400640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b416bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40aa000640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40c7940 0x7f40b41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 -- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 msgr2=0x7f40b416bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b416bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 -- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40c7940 msgr2=0x7f40b41550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40c7940 0x7f40b41550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40b2a00640 1 -- 172.21.15.149:0/2634359147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009ae0 con 0x7f40b40afbe0 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.927+0000 7f40aa000640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40c7940 0x7f40b41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.928+0000 7f40b2a00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b4143110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e920 tx=0x7f40a400a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.928+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400a700 con 0x7f40b40afbe0 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.928+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a400ca40 con 0x7f40b40afbe0 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.928+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400cde0 con 0x7f40b40afbe0 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.928+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4157ee0 con 0x7f40b40afbe0 2024-08-17T02:46:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.928+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b416cc00 con 0x7f40b40afbe0 2024-08-17T02:46:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.929+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b414fdd0 con 0x7f40b40afbe0 2024-08-17T02:46:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.930+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f40a40113f0 con 0x7f40b40afbe0 2024-08-17T02:46:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.931+0000 7f40aaa00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4090065180 0x7f4090067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.931+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f40a4015030 con 0x7f40b40afbe0 2024-08-17T02:46:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.931+0000 7f40aa000640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4090065180 0x7f4090067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.931+0000 7f40aa000640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4090065180 0x7f4090067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40b406d730 tx=0x7f409c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:45.935+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40b414fdd0 con 0x7f40b40afbe0 2024-08-17T02:46:46.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.110+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40b414fdd0 con 0x7f40b40afbe0 2024-08-17T02:46:46.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.110+0000 7f40aaa00640 1 -- 172.21.15.149:0/2634359147 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40b414fdd0 con 0x7f40b40afbe0 2024-08-17T02:46:46.112 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:46:46.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.112+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4090065180 msgr2=0x7f4090067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.112+0000 7f40b3e00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4090065180 0x7f4090067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40b406d730 tx=0x7f409c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:46.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.112+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 msgr2=0x7f40b4143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.112+0000 7f40b3e00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b4143110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e920 tx=0x7f40a400a2b0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 shutdown_connections 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4090065180 0x7f4090067630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40b4154ce0 0x7f40b416bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40c7940 0x7f40b41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 --2- 172.21.15.149:0/2634359147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b40afbe0 0x7f40b4143110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 >> 172.21.15.149:0/2634359147 conn(0x7f40b4067750 msgr2=0x7f40b414f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 shutdown_connections 2024-08-17T02:46:46.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.113+0000 7f40b3e00640 1 -- 172.21.15.149:0/2634359147 wait complete. 2024-08-17T02:46:46.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:46:46.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.277+0000 7fd95a000640 1 Processor -- start 2024-08-17T02:46:46.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.277+0000 7fd95a000640 1 -- start start 2024-08-17T02:46:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.278+0000 7fd95a000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd954155180 0x7fd9540aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.278+0000 7fd95a000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd954155550 0x7fd9540ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.278+0000 7fd95a000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9540afc10 con 0x7fd95406e080 2024-08-17T02:46:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.278+0000 7fd95a000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9540ae5b0 con 0x7fd954155180 2024-08-17T02:46:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.278+0000 7fd95a000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540af000 con 0x7fd954155550 2024-08-17T02:46:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd954155180 0x7fd9540aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd954155180 0x7fd9540aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55548/0 (socket says 172.21.15.149:55548) 2024-08-17T02:46:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 -- 172.21.15.149:0/40661398 learned_addr learned my addr 172.21.15.149:0/40661398 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd952a00640 1 --2- 172.21.15.149:0/40661398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd954155550 0x7fd9540ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 -- 172.21.15.149:0/40661398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd954155550 msgr2=0x7fd9540ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 --2- 172.21.15.149:0/40661398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd954155550 0x7fd9540ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 -- 172.21.15.149:0/40661398 >> v1:172.21.15.161:6789/0 conn(0x7fd95406e080 legacy=0x7fd95406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.279+0000 7fd953400640 1 -- 172.21.15.149:0/40661398 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540af2e0 con 0x7fd954155180 2024-08-17T02:46:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.280+0000 7fd953400640 1 --2- 172.21.15.149:0/40661398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd9540aea20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd944009910 tx=0x7fd9440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64112bc4b65de330 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.280+0000 7fd952000640 1 -- 172.21.15.149:0/40661398 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94402ae40 con 0x7fd954155180 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.280+0000 7fd952000640 1 -- 172.21.15.149:0/40661398 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944032440 con 0x7fd954155180 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.280+0000 7fd952000640 1 -- 172.21.15.149:0/40661398 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944032820 con 0x7fd954155180 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 -- 172.21.15.149:0/40661398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 msgr2=0x7fd9540aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 --2- 172.21.15.149:0/40661398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd9540aea20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd944009910 tx=0x7fd9440091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 -- 172.21.15.149:0/40661398 shutdown_connections 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 --2- 172.21.15.149:0/40661398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd954155550 0x7fd9540ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 --2- 172.21.15.149:0/40661398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd9540aea20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 -- 172.21.15.149:0/40661398 >> 172.21.15.149:0/40661398 conn(0x7fd9540cb9b0 msgr2=0x7fd9540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 -- 172.21.15.149:0/40661398 shutdown_connections 2024-08-17T02:46:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.281+0000 7fd95a000640 1 -- 172.21.15.149:0/40661398 wait complete. 2024-08-17T02:46:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.282+0000 7fd95a000640 1 Processor -- start 2024-08-17T02:46:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.283+0000 7fd95a000640 1 -- start start 2024-08-17T02:46:46.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd95a000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95406e080 0x7fd954147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd95a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd954146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd95a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd954155550 0x7fd954147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd95a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540c9a50 con 0x7fd954155180 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd95a000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954145aa0 con 0x7fd954155550 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd95a000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd954145d80 con 0x7fd95406e080 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd954146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd954146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55550/0 (socket says 172.21.15.149:55550) 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 -- 172.21.15.149:0/2487249864 learned_addr learned my addr 172.21.15.149:0/2487249864 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd953400640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95406e080 0x7fd954147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd953e00640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd954155550 0x7fd954147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 -- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95406e080 msgr2=0x7fd954147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95406e080 0x7fd954147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 -- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd954155550 msgr2=0x7fd954147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd954155550 0x7fd954147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 -- 172.21.15.149:0/2487249864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944009450 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.284+0000 7fd952a00640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd954146b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd94000e900 tx=0x7fd9400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.285+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000c940 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.285+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94000cac0 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.285+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd954146060 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.285+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000ce80 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.285+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd954146620 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.286+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd954146840 con 0x7fd954155180 2024-08-17T02:46:46.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.287+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd940013680 con 0x7fd954155180 2024-08-17T02:46:46.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.287+0000 7fd94aa00640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd934065150 0x7fd934067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.288+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd940082250 con 0x7fd954155180 2024-08-17T02:46:46.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.288+0000 7fd953400640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd934065150 0x7fd934067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.288+0000 7fd953400640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd934065150 0x7fd934067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd944034000 tx=0x7fd944032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.291+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd940050710 con 0x7fd954155180 2024-08-17T02:46:46.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.467+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd954064db0 con 0x7fd954155180 2024-08-17T02:46:46.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.468+0000 7fd94aa00640 1 -- 172.21.15.149:0/2487249864 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd940053d30 con 0x7fd954155180 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:46:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:] 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd934065150 msgr2=0x7fd934067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd934065150 0x7fd934067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd944034000 tx=0x7fd944032000 comp rx=0 tx=0).stop 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 msgr2=0x7fd954146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd954146b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd94000e900 tx=0x7fd9400090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 shutdown_connections 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd934065150 0x7fd934067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd954155550 0x7fd954147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd954155180 0x7fd954146b40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 --2- 172.21.15.149:0/2487249864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95406e080 0x7fd954147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 >> 172.21.15.149:0/2487249864 conn(0x7fd9540cb9b0 msgr2=0x7fd9540695d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 shutdown_connections 2024-08-17T02:46:46.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.470+0000 7fd95a000640 1 -- 172.21.15.149:0/2487249864 wait complete. 2024-08-17T02:46:46.487 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:46:46.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:46:46.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.636+0000 7f93e1600640 1 Processor -- start 2024-08-17T02:46:46.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.636+0000 7f93e1600640 1 -- start start 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93e1600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93dc06df00 0x7f93dc06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93e1600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc15a0e0 0x7f93dc0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93e1600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc0af5f0 con 0x7f93dc0aae40 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93e1600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc159600 con 0x7f93dc06df00 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93e1600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc1598e0 con 0x7f93dc15a0e0 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93dc06df00 0x7f93dc06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93dc06df00 0x7f93dc06e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55552/0 (socket says 172.21.15.149:55552) 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 -- 172.21.15.149:0/3407746703 learned_addr learned my addr 172.21.15.149:0/3407746703 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93d3400640 1 --2- 172.21.15.149:0/3407746703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc15a0e0 0x7f93dc0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 -- 172.21.15.149:0/3407746703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc15a0e0 msgr2=0x7f93dc0aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 --2- 172.21.15.149:0/3407746703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc15a0e0 0x7f93dc0aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 -- 172.21.15.149:0/3407746703 >> v1:172.21.15.149:6789/0 conn(0x7f93dc0aae40 legacy=0x7f93dc0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93db400640 1 -- 172.21.15.149:0/3407746703 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343539297 0 0) 0x7f93dc0af5f0 con 0x7f93dc0aae40 2024-08-17T02:46:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.638+0000 7f93dbe00640 1 -- 172.21.15.149:0/3407746703 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc159bc0 con 0x7f93dc06df00 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.639+0000 7f93dbe00640 1 --2- 172.21.15.149:0/3407746703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc06df00 0x7f93dc06e2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009910 tx=0x7f93cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fca8e30d77c695 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93db400640 1 -- 172.21.15.149:0/3407746703 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc02ae40 con 0x7f93dc06df00 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93db400640 1 -- 172.21.15.149:0/3407746703 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc032440 con 0x7f93dc06df00 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93db400640 1 -- 172.21.15.149:0/3407746703 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0327e0 con 0x7f93dc06df00 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 -- 172.21.15.149:0/3407746703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc06df00 msgr2=0x7f93dc06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 --2- 172.21.15.149:0/3407746703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc06df00 0x7f93dc06e2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009910 tx=0x7f93cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 -- 172.21.15.149:0/3407746703 shutdown_connections 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 --2- 172.21.15.149:0/3407746703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc15a0e0 0x7f93dc0aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 --2- 172.21.15.149:0/3407746703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc06df00 0x7f93dc06e2d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 -- 172.21.15.149:0/3407746703 >> 172.21.15.149:0/3407746703 conn(0x7f93dc067750 msgr2=0x7f93dc06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 -- 172.21.15.149:0/3407746703 shutdown_connections 2024-08-17T02:46:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.640+0000 7f93e1600640 1 -- 172.21.15.149:0/3407746703 wait complete. 2024-08-17T02:46:46.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.642+0000 7f93e1600640 1 Processor -- start 2024-08-17T02:46:46.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.642+0000 7f93e1600640 1 -- start start 2024-08-17T02:46:46.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e1600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc06df00 0x7f93dc14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e1600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93dc0aae40 0x7f93dc14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 0x7f93dc16a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc1579f0 con 0x7f93dc15a0e0 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e1600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc14dcc0 con 0x7f93dc0aae40 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e1600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc152ed0 con 0x7f93dc06df00 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 0x7f93dc16a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93dbe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc06df00 0x7f93dc14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 0x7f93dc16a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55556/0 (socket says 172.21.15.149:55556) 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 -- 172.21.15.149:0/2507656735 learned_addr learned my addr 172.21.15.149:0/2507656735 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93d3400640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93dc0aae40 0x7f93dc14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 -- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc06df00 msgr2=0x7f93dc14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc06df00 0x7f93dc14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 -- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93dc0aae40 msgr2=0x7f93dc14bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93dc0aae40 0x7f93dc14bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.643+0000 7f93e0c00640 1 -- 172.21.15.149:0/2507656735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009450 con 0x7f93dc15a0e0 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.644+0000 7f93e0c00640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 0x7f93dc16a350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93d4001560 tx=0x7f93d40016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.644+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d400a7f0 con 0x7f93dc15a0e0 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.644+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d400a950 con 0x7f93dc15a0e0 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.644+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc1570c0 con 0x7f93dc15a0e0 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.644+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d400ad10 con 0x7f93dc15a0e0 2024-08-17T02:46:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.644+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc157680 con 0x7f93dc15a0e0 2024-08-17T02:46:46.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.645+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc157ba0 con 0x7f93dc15a0e0 2024-08-17T02:46:46.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.646+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f93d4003030 con 0x7f93dc15a0e0 2024-08-17T02:46:46.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.647+0000 7f93d3e00640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93b8065180 0x7f93b8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.647+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f93d4082080 con 0x7f93dc15a0e0 2024-08-17T02:46:46.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.647+0000 7f93dbe00640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93b8065180 0x7f93b8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.647+0000 7f93dbe00640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93b8065180 0x7f93b8067630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93cc034000 tx=0x7f93cc032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.651+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93dc157ba0 con 0x7f93dc15a0e0 2024-08-17T02:46:46.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:46.823+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f93dc071050 con 0x7f93dc15a0e0 2024-08-17T02:46:47.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.052+0000 7f93d3e00640 1 -- 172.21.15.149:0/2507656735 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f93d40504a0 con 0x7f93dc15a0e0 2024-08-17T02:46:47.054 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2024-08-17T02:46:47.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93b8065180 msgr2=0x7f93b8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93b8065180 0x7f93b8067630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93cc034000 tx=0x7f93cc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:47.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 msgr2=0x7f93dc16a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 0x7f93dc16a350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93d4001560 tx=0x7f93d40016c0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 shutdown_connections 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93b8065180 0x7f93b8067630 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93dc15a0e0 0x7f93dc16a350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93dc0aae40 0x7f93dc14bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 --2- 172.21.15.149:0/2507656735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93dc06df00 0x7f93dc14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 >> 172.21.15.149:0/2507656735 conn(0x7f93dc067750 msgr2=0x7f93dc0ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:47.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 shutdown_connections 2024-08-17T02:46:47.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.055+0000 7f93e1600640 1 -- 172.21.15.149:0/2507656735 wait complete. 2024-08-17T02:46:47.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:46:47.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.231+0000 7ff25c000640 1 Processor -- start 2024-08-17T02:46:47.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.231+0000 7ff25c000640 1 -- start start 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff25c000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff254156d40 0x7ff25406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff25c000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff2540ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff25c000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25406e880 con 0x7ff254150130 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff25c000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2541568b0 con 0x7ff254156d40 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff25c000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff254150500 con 0x7ff25406e420 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff258c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff254156d40 0x7ff25406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff258c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff254156d40 0x7ff25406dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47842/0 (socket says 172.21.15.149:47842) 2024-08-17T02:46:47.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.232+0000 7ff258c00640 1 -- 172.21.15.149:0/2782160332 learned_addr learned my addr 172.21.15.149:0/2782160332 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:47.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.233+0000 7ff25a000640 1 --2- 172.21.15.149:0/2782160332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff2540ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.233+0000 7ff258c00640 1 -- 172.21.15.149:0/2782160332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 msgr2=0x7ff2540ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:47.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.233+0000 7ff258c00640 1 --2- 172.21.15.149:0/2782160332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff2540ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.233+0000 7ff258c00640 1 -- 172.21.15.149:0/2782160332 >> v1:172.21.15.161:6789/0 conn(0x7ff254150130 legacy=0x7ff2540aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.233+0000 7ff258c00640 1 -- 172.21.15.149:0/2782160332 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254155fc0 con 0x7ff254156d40 2024-08-17T02:46:47.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.234+0000 7ff258c00640 1 --2- 172.21.15.149:0/2782160332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff25406dee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff240009910 tx=0x7ff2400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba84b55fd331678 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:47.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.234+0000 7ff253e00640 1 -- 172.21.15.149:0/2782160332 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24002adb0 con 0x7ff254156d40 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.234+0000 7ff253e00640 1 -- 172.21.15.149:0/2782160332 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff240032440 con 0x7ff254156d40 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.234+0000 7ff253e00640 1 -- 172.21.15.149:0/2782160332 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240032820 con 0x7ff254156d40 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 -- 172.21.15.149:0/2782160332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 msgr2=0x7ff25406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 --2- 172.21.15.149:0/2782160332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff25406dee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff240009910 tx=0x7ff2400091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 -- 172.21.15.149:0/2782160332 shutdown_connections 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 --2- 172.21.15.149:0/2782160332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff2540ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 --2- 172.21.15.149:0/2782160332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff25406dee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 -- 172.21.15.149:0/2782160332 >> 172.21.15.149:0/2782160332 conn(0x7ff254067750 msgr2=0x7ff25406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 -- 172.21.15.149:0/2782160332 shutdown_connections 2024-08-17T02:46:47.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.235+0000 7ff25c000640 1 -- 172.21.15.149:0/2782160332 wait complete. 2024-08-17T02:46:47.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.236+0000 7ff25c000640 1 Processor -- start 2024-08-17T02:46:47.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.236+0000 7ff25c000640 1 -- start start 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25c000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff254169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25c000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff254150130 0x7ff254168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff2540cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff254155a00 con 0x7ff254156d40 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25c000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff254152f00 con 0x7ff254150130 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25c000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff254169350 con 0x7ff25406e420 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff2540cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff2540cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47850/0 (socket says 172.21.15.149:47850) 2024-08-17T02:46:47.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff25a000640 1 -- 172.21.15.149:0/78768257 learned_addr learned my addr 172.21.15.149:0/78768257 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:47.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.237+0000 7ff258c00640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff254150130 0x7ff254168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff259600640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff254169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25a000640 1 -- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 msgr2=0x7ff254169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25a000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff254169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25a000640 1 -- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff254150130 msgr2=0x7ff254168cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25a000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff254150130 0x7ff254168cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25a000640 1 -- 172.21.15.149:0/78768257 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009450 con 0x7ff254156d40 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25a000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff2540cac00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009fa0 tx=0x7ff24c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:47.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00ee60 con 0x7ff254156d40 2024-08-17T02:46:47.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c014420 con 0x7ff254156d40 2024-08-17T02:46:47.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff254169630 con 0x7ff254156d40 2024-08-17T02:46:47.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.238+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0147e0 con 0x7ff254156d40 2024-08-17T02:46:47.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.239+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff254169bf0 con 0x7ff254156d40 2024-08-17T02:46:47.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.239+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff254153070 con 0x7ff254156d40 2024-08-17T02:46:47.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.241+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff24c014b50 con 0x7ff254156d40 2024-08-17T02:46:47.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.242+0000 7ff250c00640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff234065150 0x7ff234067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.242+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ff24c083a20 con 0x7ff254156d40 2024-08-17T02:46:47.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.242+0000 7ff259600640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff234065150 0x7ff234067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.243+0000 7ff259600640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff234065150 0x7ff234067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff248007fd0 tx=0x7ff248007df0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:47.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.246+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff24c051e10 con 0x7ff254156d40 2024-08-17T02:46:47.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:47.417+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff2540710c0 con 0x7ff254156d40 2024-08-17T02:46:48.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.060+0000 7ff250c00640 1 -- 172.21.15.149:0/78768257 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff24c055430 con 0x7ff254156d40 2024-08-17T02:46:48.063 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.067+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff234065150 msgr2=0x7ff234067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.067+0000 7ff25c000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff234065150 0x7ff234067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff248007fd0 tx=0x7ff248007df0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.067+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 msgr2=0x7ff2540cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.067+0000 7ff25c000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff2540cac00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009fa0 tx=0x7ff24c009900 comp rx=0 tx=0).stop 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 shutdown_connections 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff234065150 0x7ff234067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254156d40 0x7ff2540cac00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff254150130 0x7ff254168cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 --2- 172.21.15.149:0/78768257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff25406e420 0x7ff254169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 >> 172.21.15.149:0/78768257 conn(0x7ff254067750 msgr2=0x7ff2540690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:48.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.068+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 shutdown_connections 2024-08-17T02:46:48.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.069+0000 7ff25c000640 1 -- 172.21.15.149:0/78768257 wait complete. 2024-08-17T02:46:48.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.245+0000 7f7a48200640 1 Processor -- start 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.245+0000 7f7a48200640 1 -- start start 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a48200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a400caa20 0x7f7a400c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a48200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 0x7f7a400c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a48200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a400cb540 con 0x7f7a40158e20 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a48200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a400cf7f0 con 0x7f7a400caa20 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a48200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400caef0 con 0x7f7a400c3390 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a45800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7a40158e20 0x7f7a400ca310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35504/0 (socket says 172.21.15.149:35504) 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.246+0000 7f7a45800640 1 -- 172.21.15.149:0/4048781235 learned_addr learned my addr 172.21.15.149:0/4048781235 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106980884 0 0) 0x7f7a400cb540 con 0x7f7a40158e20 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a280034e0 con 0x7f7a40158e20 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a46200640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 0x7f7a400c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a44e00640 1 --2- 172.21.15.149:0/4048781235 >> v2:172.21.15.161:3300/0 conn(0x7f7a400caa20 0x7f7a400c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422132837 0 0) 0x7f7a280034e0 con 0x7f7a40158e20 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 msgr2=0x7f7a400c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 0x7f7a400c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 >> v2:172.21.15.161:3300/0 conn(0x7f7a400caa20 msgr2=0x7f7a400c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 --2- 172.21.15.149:0/4048781235 >> v2:172.21.15.161:3300/0 conn(0x7f7a400caa20 0x7f7a400c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400cb1d0 con 0x7f7a40158e20 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f7a34001470 con 0x7f7a40158e20 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 >> v1:172.21.15.149:6789/0 conn(0x7f7a40158e20 legacy=0x7f7a400ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a280039d0 0x7f7a28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 0x7f7a28004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a28005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400cf7f0 con 0x7f7a28004cc0 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400caef0 con 0x7f7a280039d0 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2800b9d0 con 0x7f7a400c3390 2024-08-17T02:46:48.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.247+0000 7f7a46200640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a28005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a45800640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a280039d0 0x7f7a28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a44e00640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 0x7f7a28004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a46200640 1 -- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 msgr2=0x7f7a28004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a46200640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c3390 0x7f7a28004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a46200640 1 -- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a280039d0 msgr2=0x7f7a28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a46200640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a280039d0 0x7f7a28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a46200640 1 -- 172.21.15.149:0/4048781235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280034e0 con 0x7f7a28004cc0 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.248+0000 7f7a45800640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a280039d0 0x7f7a28003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:48.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a46200640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a28005130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a400c6d30 tx=0x7f7a3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6c74e7232c9e2d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a380313f0 con 0x7f7a28004cc0 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3800f040 con 0x7f7a28004cc0 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a3fe00640 1 -- 172.21.15.149:0/4048781235 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38031760 con 0x7f7a28004cc0 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a48200640 1 -- 172.21.15.149:0/4048781235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 msgr2=0x7f7a28005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a48200640 1 --2- 172.21.15.149:0/4048781235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a28005130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a400c6d30 tx=0x7f7a3800b040 comp rx=0 tx=0).stop 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.249+0000 7f7a46200640 1 -- 172.21.15.149:0/4048781235 reap_dead start 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.250+0000 7f7a48200640 1 -- 172.21.15.149:0/4048781235 shutdown_connections 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.250+0000 7f7a48200640 1 -- 172.21.15.149:0/4048781235 >> 172.21.15.149:0/4048781235 conn(0x7f7a400cfd70 msgr2=0x7f7a400d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.250+0000 7f7a48200640 1 -- 172.21.15.149:0/4048781235 shutdown_connections 2024-08-17T02:46:48.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.250+0000 7f7a48200640 1 -- 172.21.15.149:0/4048781235 wait complete. 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.251+0000 7f7a48200640 1 Processor -- start 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.251+0000 7f7a48200640 1 -- start start 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a48200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a401561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a48200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c5780 0x7f7a400b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a48200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400c4140 0x7f7a400677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a48200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c52f0 con 0x7f7a28004cc0 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a48200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c46e0 con 0x7f7a400c4140 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a48200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c49c0 con 0x7f7a400c5780 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a45800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a401561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a45800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a401561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47870/0 (socket says 172.21.15.149:47870) 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a45800640 1 -- 172.21.15.149:0/2127952350 learned_addr learned my addr 172.21.15.149:0/2127952350 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a44e00640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c5780 0x7f7a400b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.252+0000 7f7a46200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400c4140 0x7f7a400677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a45800640 1 -- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c5780 msgr2=0x7f7a400b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a45800640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c5780 0x7f7a400b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a45800640 1 -- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400c4140 msgr2=0x7f7a400677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a45800640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400c4140 0x7f7a400677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a45800640 1 -- 172.21.15.149:0/2127952350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400c4ca0 con 0x7f7a28004cc0 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a45800640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a401561c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a34001ed0 tx=0x7f7a400cb4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400a850 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34010040 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a400c4f80 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400abc0 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.253+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a40067d20 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.254+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40071050 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.255+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a340143f0 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.256+0000 7f7a3cc00640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7a20065180 0x7f7a20067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.256+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7a340819f0 con 0x7f7a28004cc0 2024-08-17T02:46:48.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.256+0000 7f7a44e00640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7a20065180 0x7f7a20067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.257+0000 7f7a44e00640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7a20065180 0x7f7a20067630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a400684a0 tx=0x7f7a2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.260+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a34088080 con 0x7f7a28004cc0 2024-08-17T02:46:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:48.467+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7a400c6b40 con 0x7f7a28004cc0 2024-08-17T02:46:49.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.062+0000 7f7a3cc00640 1 -- 172.21.15.149:0/2127952350 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7a340190c0 con 0x7f7a28004cc0 2024-08-17T02:46:49.064 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:46:49.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.067+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7a20065180 msgr2=0x7f7a20067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.067+0000 7f7a48200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7a20065180 0x7f7a20067630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a400684a0 tx=0x7f7a2c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:49.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.067+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 msgr2=0x7f7a401561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.067+0000 7f7a48200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a401561c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a34001ed0 tx=0x7f7a400cb4b0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.069+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 shutdown_connections 2024-08-17T02:46:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.069+0000 7f7a48200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7a20065180 0x7f7a20067630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.069+0000 7f7a48200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400c4140 0x7f7a400677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.069+0000 7f7a48200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a400c5780 0x7f7a400b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.069+0000 7f7a48200640 1 --2- 172.21.15.149:0/2127952350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a28004cc0 0x7f7a401561c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.069+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 >> 172.21.15.149:0/2127952350 conn(0x7f7a400cfd70 msgr2=0x7f7a400c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.073+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 shutdown_connections 2024-08-17T02:46:49.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.076+0000 7f7a48200640 1 -- 172.21.15.149:0/2127952350 wait complete. 2024-08-17T02:46:49.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:49.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.253+0000 7f0f52a00640 1 Processor -- start 2024-08-17T02:46:49.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.253+0000 7f0f52a00640 1 -- start start 2024-08-17T02:46:49.256 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.256 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f52a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0f4c0ce6d0 0x7f0f4c0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f52a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c0cc890 con 0x7f0f4c0cacf0 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f52a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c0ceb20 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f52a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0cb4c0 con 0x7f0f4c0aed50 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f50c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0f4c0ce6d0 0x7f0f4c0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f50c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0f4c0ce6d0 0x7f0f4c0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47878/0 (socket says 172.21.15.149:47878) 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f50c00640 1 -- 172.21.15.149:0/1246069177 learned_addr learned my addr 172.21.15.149:0/1246069177 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.254+0000 7f0f51600640 1 --2- 172.21.15.149:0/1246069177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.255+0000 7f0f50c00640 1 -- 172.21.15.149:0/1246069177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 msgr2=0x7f0f4c0ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.255+0000 7f0f50c00640 1 --2- 172.21.15.149:0/1246069177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c0ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.255+0000 7f0f50c00640 1 -- 172.21.15.149:0/1246069177 >> v1:172.21.15.161:6789/0 conn(0x7f0f4c0cacf0 legacy=0x7f0f4c0c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.255+0000 7f0f50c00640 1 -- 172.21.15.149:0/1246069177 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0cb7a0 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.256+0000 7f0f50c00640 1 --2- 172.21.15.149:0/1246069177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0ca7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009910 tx=0x7f0f380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e88ccfa947e0c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.256+0000 7f0f4be00640 1 -- 172.21.15.149:0/1246069177 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3802ae40 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.256+0000 7f0f4be00640 1 -- 172.21.15.149:0/1246069177 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f38032440 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.256+0000 7f0f4be00640 1 -- 172.21.15.149:0/1246069177 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38032820 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 -- 172.21.15.149:0/1246069177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 msgr2=0x7f0f4c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 --2- 172.21.15.149:0/1246069177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0ca7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009910 tx=0x7f0f380091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 -- 172.21.15.149:0/1246069177 shutdown_connections 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 --2- 172.21.15.149:0/1246069177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0ca7b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 --2- 172.21.15.149:0/1246069177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c0ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 -- 172.21.15.149:0/1246069177 >> 172.21.15.149:0/1246069177 conn(0x7f0f4c098e30 msgr2=0x7f0f4c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 -- 172.21.15.149:0/1246069177 shutdown_connections 2024-08-17T02:46:49.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.257+0000 7f0f52a00640 1 -- 172.21.15.149:0/1246069177 wait complete. 2024-08-17T02:46:49.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.258+0000 7f0f52a00640 1 Processor -- start 2024-08-17T02:46:49.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.258+0000 7f0f52a00640 1 -- start start 2024-08-17T02:46:49.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.259+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c16bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.259+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4c0cacf0 0x7f0f4c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.259+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.259+0000 7f0f52a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0b00f0 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.259+0000 7f0f52a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1695b0 con 0x7f0f4c0cacf0 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.259+0000 7f0f52a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0b3790 con 0x7f0f4c0aed50 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47894/0 (socket says 172.21.15.149:47894) 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 -- 172.21.15.149:0/828736227 learned_addr learned my addr 172.21.15.149:0/828736227 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f51600640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c16bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f50c00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4c0cacf0 0x7f0f4c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 -- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 msgr2=0x7f0f4c16bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c16bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 -- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4c0cacf0 msgr2=0x7f0f4c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4c0cacf0 0x7f0f4c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 -- 172.21.15.149:0/828736227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f38009450 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f52000640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0c6c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c7c0 tx=0x7f0f440015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400a640 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4400a7c0 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.260+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400ab80 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.261+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4c0b0340 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.261+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c0b0900 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.262+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c071050 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.262+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0f44003030 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.263+0000 7f0f48c00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0f2c065180 0x7f0f2c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.263+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f44082250 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.263+0000 7f0f51600640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0f2c065180 0x7f0f2c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.264+0000 7f0f51600640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0f2c065180 0x7f0f2c067630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c80 tx=0x7f0f400090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.267+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0f44050320 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.440+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f4c0b2150 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.441+0000 7f0f48c00640 1 -- 172.21.15.149:0/828736227 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f0f44053940 con 0x7f0f4c0ce6d0 2024-08-17T02:46:49.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:49.443 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:48.469395+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:49.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0f2c065180 msgr2=0x7f0f2c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0f2c065180 0x7f0f2c067630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c80 tx=0x7f0f400090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 msgr2=0x7f0f4c0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0c6c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c7c0 tx=0x7f0f440015f0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 shutdown_connections 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0f2c065180 0x7f0f2c067630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4c0ce6d0 0x7f0f4c0c6c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4c0cacf0 0x7f0f4c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 --2- 172.21.15.149:0/828736227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f4c0aed50 0x7f0f4c16bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 >> 172.21.15.149:0/828736227 conn(0x7f0f4c098e30 msgr2=0x7f0f4c1583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 shutdown_connections 2024-08-17T02:46:49.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.443+0000 7f0f52a00640 1 -- 172.21.15.149:0/828736227 wait complete. 2024-08-17T02:46:49.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:49.608 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.607+0000 7f9409e00640 1 Processor -- start 2024-08-17T02:46:49.609 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.607+0000 7f9409e00640 1 -- start start 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.608+0000 7f9409e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9404158bd0 0x7f9404069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.608+0000 7f9409e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94040ac710 0x7f94040af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.608+0000 7f9409e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94040aec20 con 0x7f9404069540 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.608+0000 7f9409e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94040699c0 con 0x7f9404158bd0 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.608+0000 7f9409e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040acb10 con 0x7f94040ac710 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9403e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9404069540 0x7f94040ac000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35506/0 (socket says 172.21.15.149:35506) 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9403e00640 1 -- 172.21.15.149:0/3178046220 learned_addr learned my addr 172.21.15.149:0/3178046220 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9408a00640 1 --2- 172.21.15.149:0/3178046220 >> v2:172.21.15.161:3300/0 conn(0x7f9404158bd0 0x7f9404069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9409400640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94040ac710 0x7f94040af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9403400640 1 -- 172.21.15.149:0/3178046220 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115413518 0 0) 0x7f94040aec20 con 0x7f9404069540 2024-08-17T02:46:49.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9403400640 1 -- 172.21.15.149:0/3178046220 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e80034e0 con 0x7f9404069540 2024-08-17T02:46:49.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9408a00640 1 -- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94040ac710 msgr2=0x7f94040af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:49.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9408a00640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94040ac710 0x7f94040af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9408a00640 1 -- 172.21.15.149:0/3178046220 >> v1:172.21.15.149:6789/0 conn(0x7f9404069540 legacy=0x7f94040ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9408a00640 1 -- 172.21.15.149:0/3178046220 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040ae330 con 0x7f9404158bd0 2024-08-17T02:46:49.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.609+0000 7f9409400640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94040ac710 0x7f94040af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.610+0000 7f9408a00640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9404158bd0 0x7f9404069000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009880 tx=0x7f93f40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1644ce28a562a9b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9403400640 1 -- 172.21.15.149:0/3178046220 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f402ace0 con 0x7f9404158bd0 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9403400640 1 -- 172.21.15.149:0/3178046220 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f402ae40 con 0x7f9404158bd0 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9403400640 1 -- 172.21.15.149:0/3178046220 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4032670 con 0x7f9404158bd0 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9409e00640 1 -- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9404158bd0 msgr2=0x7f9404069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9409e00640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9404158bd0 0x7f9404069000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009880 tx=0x7f93f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9409e00640 1 -- 172.21.15.149:0/3178046220 shutdown_connections 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9409e00640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94040ac710 0x7f94040af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9409e00640 1 --2- 172.21.15.149:0/3178046220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9404158bd0 0x7f9404069000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.611+0000 7f9409e00640 1 -- 172.21.15.149:0/3178046220 >> 172.21.15.149:0/3178046220 conn(0x7f9404096a70 msgr2=0x7f94040cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.612+0000 7f9409e00640 1 -- 172.21.15.149:0/3178046220 shutdown_connections 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.612+0000 7f9409e00640 1 -- 172.21.15.149:0/3178046220 wait complete. 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.613+0000 7f9409e00640 1 Processor -- start 2024-08-17T02:46:49.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.613+0000 7f9409e00640 1 -- start start 2024-08-17T02:46:49.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 0x7f94040c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94040ac710 0x7f94041537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9404158bd0 0x7f94040cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94040c8ea0 con 0x7f9404069540 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94040c8290 con 0x7f94040ac710 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040c8570 con 0x7f9404158bd0 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9408a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 0x7f94040c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9408a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 0x7f94040c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47898/0 (socket says 172.21.15.149:47898) 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9408a00640 1 -- 172.21.15.149:0/934870371 learned_addr learned my addr 172.21.15.149:0/934870371 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9403e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94040ac710 0x7f94041537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.614+0000 7f9409400640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9404158bd0 0x7f94040cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9408a00640 1 -- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9404158bd0 msgr2=0x7f94040cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9408a00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9404158bd0 0x7f94040cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9408a00640 1 -- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94040ac710 msgr2=0x7f94041537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9408a00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94040ac710 0x7f94041537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9408a00640 1 -- 172.21.15.149:0/934870371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009a20 con 0x7f9404069540 2024-08-17T02:46:49.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9403e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94040ac710 0x7f94041537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:49.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9408a00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 0x7f94040c7990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009880 tx=0x7f93f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f403c6f0 con 0x7f9404069540 2024-08-17T02:46:49.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f403c870 con 0x7f9404069540 2024-08-17T02:46:49.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f4009390 con 0x7f9404069540 2024-08-17T02:46:49.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.615+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f403cc30 con 0x7f9404069540 2024-08-17T02:46:49.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.616+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94040c8b30 con 0x7f9404069540 2024-08-17T02:46:49.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.617+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404071050 con 0x7f9404069540 2024-08-17T02:46:49.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.618+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f93f4039050 con 0x7f9404069540 2024-08-17T02:46:49.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.618+0000 7f93fbe00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93e4065180 0x7f93e4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.618+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93f40a2790 con 0x7f9404069540 2024-08-17T02:46:49.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.619+0000 7f9403e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93e4065180 0x7f93e4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.619+0000 7f9403e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93e4065180 0x7f93e4067630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94040c7740 tx=0x7f93f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.622+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93f4070850 con 0x7f9404069540 2024-08-17T02:46:49.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.796+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94040ce850 con 0x7f9404069540 2024-08-17T02:46:49.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.797+0000 7f93fbe00640 1 -- 172.21.15.149:0/934870371 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f93f4037090 con 0x7f9404069540 2024-08-17T02:46:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:49.799 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:48.469395+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:49.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93e4065180 msgr2=0x7f93e4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93e4065180 0x7f93e4067630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94040c7740 tx=0x7f93f0009040 comp rx=0 tx=0).stop 2024-08-17T02:46:49.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 msgr2=0x7f94040c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 0x7f94040c7990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009880 tx=0x7f93f4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:49.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 shutdown_connections 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f93e4065180 0x7f93e4067630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9404158bd0 0x7f94040cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94040ac710 0x7f94041537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 --2- 172.21.15.149:0/934870371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9404069540 0x7f94040c7990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.799+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 >> 172.21.15.149:0/934870371 conn(0x7f9404096a70 msgr2=0x7f94040abee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.800+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 shutdown_connections 2024-08-17T02:46:49.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.800+0000 7f9409e00640 1 -- 172.21.15.149:0/934870371 wait complete. 2024-08-17T02:46:49.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:46:49.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.966+0000 7fe643800640 1 Processor -- start 2024-08-17T02:46:49.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.966+0000 7fe643800640 1 -- start start 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe643800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe63c158e20 0x7fe63c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe643800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0cb540 con 0x7fe63c0c3390 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe643800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0ce6c0 con 0x7fe63c088f20 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe643800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0cf7f0 con 0x7fe63c158e20 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe63be00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe63c0c3390 0x7fe63c0cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35508/0 (socket says 172.21.15.149:35508) 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe63be00640 1 -- 172.21.15.149:0/338287406 learned_addr learned my addr 172.21.15.149:0/338287406 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:49.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.967+0000 7fe640e00640 1 --2- 172.21.15.149:0/338287406 >> v2:172.21.15.161:3300/0 conn(0x7fe63c158e20 0x7fe63c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.970 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284864438 0 0) 0x7fe63c0cb540 con 0x7fe63c0c3390 2024-08-17T02:46:49.970 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6240034e0 con 0x7fe63c0c3390 2024-08-17T02:46:49.970 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166725115 0 0) 0x7fe63c0ce6c0 con 0x7fe63c088f20 2024-08-17T02:46:49.970 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe63c0cb540 con 0x7fe63c088f20 2024-08-17T02:46:49.970 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe640e00640 1 -- 172.21.15.149:0/338287406 >> v1:172.21.15.161:6789/0 conn(0x7fe63c088f20 legacy=0x7fe63c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.971 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe640e00640 1 -- 172.21.15.149:0/338287406 >> v1:172.21.15.149:6789/0 conn(0x7fe63c0c3390 legacy=0x7fe63c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.971 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.968+0000 7fe640e00640 1 -- 172.21.15.149:0/338287406 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0caef0 con 0x7fe63c158e20 2024-08-17T02:46:49.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.969+0000 7fe640e00640 1 --2- 172.21.15.149:0/338287406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c158e20 0x7fe63c0ca310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe6300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd93409c66c9659 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.969+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63002ae20 con 0x7fe63c158e20 2024-08-17T02:46:49.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.969+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630032440 con 0x7fe63c158e20 2024-08-17T02:46:49.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.969+0000 7fe63b400640 1 -- 172.21.15.149:0/338287406 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300327e0 con 0x7fe63c158e20 2024-08-17T02:46:49.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 -- 172.21.15.149:0/338287406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c158e20 msgr2=0x7fe63c0ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 --2- 172.21.15.149:0/338287406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c158e20 0x7fe63c0ca310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe6300090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 -- 172.21.15.149:0/338287406 shutdown_connections 2024-08-17T02:46:49.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 --2- 172.21.15.149:0/338287406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c158e20 0x7fe63c0ca310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 -- 172.21.15.149:0/338287406 >> 172.21.15.149:0/338287406 conn(0x7fe63c0cfd70 msgr2=0x7fe63c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 -- 172.21.15.149:0/338287406 shutdown_connections 2024-08-17T02:46:49.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.970+0000 7fe643800640 1 -- 172.21.15.149:0/338287406 wait complete. 2024-08-17T02:46:49.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.971+0000 7fe643800640 1 Processor -- start 2024-08-17T02:46:49.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 -- start start 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 0x7fe63c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c0c3390 0x7fe63c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c158e20 0x7fe63c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0c51f0 con 0x7fe63c088f20 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0c6770 con 0x7fe63c0c3390 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.972+0000 7fe643800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c169240 con 0x7fe63c158e20 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 0x7fe63c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 0x7fe63c1564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47914/0 (socket says 172.21.15.149:47914) 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 -- 172.21.15.149:0/4019058785 learned_addr learned my addr 172.21.15.149:0/4019058785 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe63be00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c0c3390 0x7fe63c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe641800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c158e20 0x7fe63c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 -- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c158e20 msgr2=0x7fe63c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c158e20 0x7fe63c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 -- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c0c3390 msgr2=0x7fe63c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c0c3390 0x7fe63c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 -- 172.21.15.149:0/4019058785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009390 con 0x7fe63c088f20 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe63be00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c0c3390 0x7fe63c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.973+0000 7fe640e00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 0x7fe63c1564f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe630032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.974+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630000c40 con 0x7fe63c088f20 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.974+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630031a60 con 0x7fe63c088f20 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.974+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630031e20 con 0x7fe63c088f20 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.974+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c1694e0 con 0x7fe63c088f20 2024-08-17T02:46:49.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.974+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c0c4950 con 0x7fe63c088f20 2024-08-17T02:46:49.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.975+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c071050 con 0x7fe63c088f20 2024-08-17T02:46:49.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.976+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe630039040 con 0x7fe63c088f20 2024-08-17T02:46:49.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.976+0000 7fe62fe00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe61c065150 0x7fe61c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.976+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6300a1f30 con 0x7fe63c088f20 2024-08-17T02:46:49.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.977+0000 7fe63be00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe61c065150 0x7fe61c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.977+0000 7fe63be00640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe61c065150 0x7fe61c067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe63c1582b0 tx=0x7fe628009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:49.980+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe63006fff0 con 0x7fe63c088f20 2024-08-17T02:46:50.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:50.200+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe63c067260 con 0x7fe63c088f20 2024-08-17T02:46:51.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.086+0000 7fe62fe00640 1 -- 172.21.15.149:0/4019058785 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe630073610 con 0x7fe63c088f20 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe61c065150 msgr2=0x7fe61c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe61c065150 0x7fe61c067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe63c1582b0 tx=0x7fe628009040 comp rx=0 tx=0).stop 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 msgr2=0x7fe63c1564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 0x7fe63c1564f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe630032000 comp rx=0 tx=0).stop 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 shutdown_connections 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe61c065150 0x7fe61c067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c158e20 0x7fe63c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c0c3390 0x7fe63c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 --2- 172.21.15.149:0/4019058785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe63c088f20 0x7fe63c1564f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 >> 172.21.15.149:0/4019058785 conn(0x7fe63c0cfd70 msgr2=0x7fe63c0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 shutdown_connections 2024-08-17T02:46:51.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.089+0000 7fe643800640 1 -- 172.21.15.149:0/4019058785 wait complete. 2024-08-17T02:46:51.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:46:51.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.260+0000 7fd9dc600640 1 Processor -- start 2024-08-17T02:46:51.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.260+0000 7fd9dc600640 1 -- start start 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9dc600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d4156c50 0x7fd9d40c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9dc600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd9d40c8bd0 0x7fd9d40c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9dc600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40c9570 con 0x7fd9d40adcf0 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9dc600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40ab130 con 0x7fd9d40c8bd0 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9dc600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40ae5a0 con 0x7fd9d4156c50 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9da600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd9d40c8bd0 0x7fd9d40c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9d9200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd9d40adcf0 0x7fd9d40ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35516/0 (socket says 172.21.15.149:35516) 2024-08-17T02:46:51.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.261+0000 7fd9d9200640 1 -- 172.21.15.149:0/3233741194 learned_addr learned my addr 172.21.15.149:0/3233741194 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:51.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.262+0000 7fd9d9c00640 1 --2- 172.21.15.149:0/3233741194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d4156c50 0x7fd9d40c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.262+0000 7fd9da600640 1 -- 172.21.15.149:0/3233741194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d4156c50 msgr2=0x7fd9d40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.262+0000 7fd9da600640 1 --2- 172.21.15.149:0/3233741194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d4156c50 0x7fd9d40c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.262+0000 7fd9da600640 1 -- 172.21.15.149:0/3233741194 >> v1:172.21.15.149:6789/0 conn(0x7fd9d40adcf0 legacy=0x7fd9d40ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.262+0000 7fd9da600640 1 -- 172.21.15.149:0/3233741194 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40ae2c0 con 0x7fd9d40c8bd0 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.262+0000 7fd9d3e00640 1 -- 172.21.15.149:0/3233741194 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670125543 0 0) 0x7fd9c0001110 con 0x7fd9d40adcf0 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.263+0000 7fd9da600640 1 --2- 172.21.15.149:0/3233741194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d40c9030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009e60 tx=0x7fd9cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3fa9cea84f86af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.263+0000 7fd9d3e00640 1 -- 172.21.15.149:0/3233741194 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc007550 con 0x7fd9d40c8bd0 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.263+0000 7fd9d3e00640 1 -- 172.21.15.149:0/3233741194 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc02d050 con 0x7fd9d40c8bd0 2024-08-17T02:46:51.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.263+0000 7fd9d3e00640 1 -- 172.21.15.149:0/3233741194 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0078e0 con 0x7fd9d40c8bd0 2024-08-17T02:46:51.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 -- 172.21.15.149:0/3233741194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d40c8bd0 msgr2=0x7fd9d40c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 --2- 172.21.15.149:0/3233741194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d40c9030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009e60 tx=0x7fd9cc009780 comp rx=0 tx=0).stop 2024-08-17T02:46:51.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 -- 172.21.15.149:0/3233741194 shutdown_connections 2024-08-17T02:46:51.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 --2- 172.21.15.149:0/3233741194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d40c9030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 --2- 172.21.15.149:0/3233741194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d4156c50 0x7fd9d40c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 -- 172.21.15.149:0/3233741194 >> 172.21.15.149:0/3233741194 conn(0x7fd9d4067750 msgr2=0x7fd9d40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 -- 172.21.15.149:0/3233741194 shutdown_connections 2024-08-17T02:46:51.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.264+0000 7fd9dc600640 1 -- 172.21.15.149:0/3233741194 wait complete. 2024-08-17T02:46:51.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.265+0000 7fd9dc600640 1 Processor -- start 2024-08-17T02:46:51.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.265+0000 7fd9dc600640 1 -- start start 2024-08-17T02:46:51.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9dc600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d40adcf0 0x7fd9d4149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9dc600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d4155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9dc600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 0x7fd9d414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9dc600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4154330 con 0x7fd9d4156c50 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9dc600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4149850 con 0x7fd9d40c8bd0 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9dc600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4154580 con 0x7fd9d40adcf0 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.266+0000 7fd9da600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 0x7fd9d414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 0x7fd9d414c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47928/0 (socket says 172.21.15.149:47928) 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 -- 172.21.15.149:0/1595320242 learned_addr learned my addr 172.21.15.149:0/1595320242 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 -- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d40adcf0 msgr2=0x7fd9d4149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9d9c00640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d40adcf0 0x7fd9d4149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9d9200640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d4155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d40adcf0 0x7fd9d4149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 -- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9d40c8bd0 msgr2=0x7fd9d4155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d4155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 -- 172.21.15.149:0/1595320242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009a20 con 0x7fd9d4156c50 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9d9c00640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d40adcf0 0x7fd9d4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9d9200640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9da600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 0x7fd9d414c8b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0099f0 tx=0x7fd9cc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.267+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0318b0 con 0x7fd9d4156c50 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.268+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc040070 con 0x7fd9d4156c50 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.268+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc031c40 con 0x7fd9d4156c50 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.268+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d4154860 con 0x7fd9d4156c50 2024-08-17T02:46:51.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.268+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d4154e20 con 0x7fd9d4156c50 2024-08-17T02:46:51.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.269+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d4071050 con 0x7fd9d4156c50 2024-08-17T02:46:51.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.269+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9cc042030 con 0x7fd9d4156c50 2024-08-17T02:46:51.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.270+0000 7fd9d0c00640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd9b4065150 0x7fd9b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.270+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9cc0a3ec0 con 0x7fd9d4156c50 2024-08-17T02:46:51.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.270+0000 7fd9d9c00640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd9b4065150 0x7fd9b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.271+0000 7fd9d9c00640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd9b4065150 0x7fd9b4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8006e70 tx=0x7fd9c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.274+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd9cc071ee0 con 0x7fd9d4156c50 2024-08-17T02:46:51.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:51.484+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd9d40ca030 con 0x7fd9d4156c50 2024-08-17T02:46:52.028 INFO:tasks.ceph.mds.a.smithi149.stderr:2024-08-17T02:46:52.027+0000 7f7e0ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:46:52.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.092+0000 7fd9d0c00640 1 -- 172.21.15.149:0/1595320242 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd9cc075500 con 0x7fd9d4156c50 2024-08-17T02:46:52.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd9b4065150 msgr2=0x7fd9b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd9b4065150 0x7fd9b4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8006e70 tx=0x7fd9c8008040 comp rx=0 tx=0).stop 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 msgr2=0x7fd9d414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 0x7fd9d414c8b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0099f0 tx=0x7fd9cc037000 comp rx=0 tx=0).stop 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 shutdown_connections 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd9b4065150 0x7fd9b4067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9d4156c50 0x7fd9d414c8b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9d40c8bd0 0x7fd9d4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 --2- 172.21.15.149:0/1595320242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9d40adcf0 0x7fd9d4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 >> 172.21.15.149:0/1595320242 conn(0x7fd9d4067750 msgr2=0x7fd9d40affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 shutdown_connections 2024-08-17T02:46:52.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.095+0000 7fd9dc600640 1 -- 172.21.15.149:0/1595320242 wait complete. 2024-08-17T02:46:52.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:52.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.259+0000 7f25b5e00640 1 Processor -- start 2024-08-17T02:46:52.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.259+0000 7f25b5e00640 1 -- start start 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25b5e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25b0159350 0x7f25b00ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25b5e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b00cb560 con 0x7f25b00caa40 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25b5e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b00cf7e0 con 0x7f25b0158f80 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25b5e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00cfac0 con 0x7f25b0159350 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25af400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25b0159350 0x7f25b00ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25af400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25b0159350 0x7f25b00ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47940/0 (socket says 172.21.15.149:47940) 2024-08-17T02:46:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25af400640 1 -- 172.21.15.149:0/1404357167 learned_addr learned my addr 172.21.15.149:0/1404357167 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:52.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.260+0000 7f25ae000640 1 --1- 172.21.15.149:0/1404357167 >> v1:172.21.15.149:6789/0 conn(0x7f25b00caa40 0x7f25b00ace40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35528/0 (socket says 172.21.15.149:35528) 2024-08-17T02:46:52.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.261+0000 7f25af400640 1 -- 172.21.15.149:0/1404357167 >> v1:172.21.15.161:6789/0 conn(0x7f25b0158f80 legacy=0x7f25b00ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.261+0000 7f25af400640 1 -- 172.21.15.149:0/1404357167 >> v1:172.21.15.149:6789/0 conn(0x7f25b00caa40 legacy=0x7f25b00ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.261+0000 7f25af400640 1 -- 172.21.15.149:0/1404357167 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00caf10 con 0x7f25b0159350 2024-08-17T02:46:52.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25af400640 1 --2- 172.21.15.149:0/1404357167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b00ad550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009f20 tx=0x7f25a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac66dbd2783b0061 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25ad600640 1 -- 172.21.15.149:0/1404357167 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8032460 con 0x7f25b0159350 2024-08-17T02:46:52.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25ad600640 1 -- 172.21.15.149:0/1404357167 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80325c0 con 0x7f25b0159350 2024-08-17T02:46:52.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25ad600640 1 -- 172.21.15.149:0/1404357167 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80329a0 con 0x7f25b0159350 2024-08-17T02:46:52.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25b5e00640 1 -- 172.21.15.149:0/1404357167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 msgr2=0x7f25b00ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25b5e00640 1 --2- 172.21.15.149:0/1404357167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b00ad550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009f20 tx=0x7f25a8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25b5e00640 1 -- 172.21.15.149:0/1404357167 shutdown_connections 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25b5e00640 1 --2- 172.21.15.149:0/1404357167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b00ad550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.262+0000 7f25b5e00640 1 -- 172.21.15.149:0/1404357167 >> 172.21.15.149:0/1404357167 conn(0x7f25b00cfd90 msgr2=0x7f25b00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.263+0000 7f25b5e00640 1 -- 172.21.15.149:0/1404357167 shutdown_connections 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.263+0000 7f25b5e00640 1 -- 172.21.15.149:0/1404357167 wait complete. 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.264+0000 7f25b5e00640 1 Processor -- start 2024-08-17T02:46:52.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.264+0000 7f25b5e00640 1 -- start start 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25b5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b00caa40 0x7f25b0155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25b5e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b0158f80 0x7f25b00c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25b5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b0159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25b5e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b01557a0 con 0x7f25b0159350 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25b5e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c5630 con 0x7f25b00caa40 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25b5e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c4a20 con 0x7f25b0158f80 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25af400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25af400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b0159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47946/0 (socket says 172.21.15.149:47946) 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.265+0000 7f25af400640 1 -- 172.21.15.149:0/2296657694 learned_addr learned my addr 172.21.15.149:0/2296657694 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25af400640 1 -- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b0158f80 msgr2=0x7f25b00c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25af400640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b0158f80 0x7f25b00c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25af400640 1 -- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b00caa40 msgr2=0x7f25b0155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25aea00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b00caa40 0x7f25b0155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25af400640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b00caa40 0x7f25b0155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25af400640 1 -- 172.21.15.149:0/2296657694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8009ae0 con 0x7f25b0159350 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25af400640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b0159790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009f80 tx=0x7f25a8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8032460 con 0x7f25b0159350 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8008e30 con 0x7f25b0159350 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a803c660 con 0x7f25b0159350 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b00c4d00 con 0x7f25b0159350 2024-08-17T02:46:52.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.266+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b00c52c0 con 0x7f25b0159350 2024-08-17T02:46:52.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.267+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b0064db0 con 0x7f25b0159350 2024-08-17T02:46:52.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.268+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f25a8039050 con 0x7f25b0159350 2024-08-17T02:46:52.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.269+0000 7f25a6000640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2590065150 0x7f2590067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.269+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25a80a36a0 con 0x7f25b0159350 2024-08-17T02:46:52.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.269+0000 7f25aea00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2590065150 0x7f2590067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.270+0000 7f25aea00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2590065150 0x7f2590067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25a00016d0 tx=0x7f25a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.273+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f25a80716c0 con 0x7f25b0159350 2024-08-17T02:46:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.482+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25b00c5770 con 0x7f25b0159350 2024-08-17T02:46:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.483+0000 7f25a6000640 1 -- 172.21.15.149:0/2296657694 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f25a8074ce0 con 0x7f25b0159350 2024-08-17T02:46:52.485 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:52.485 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:52.485 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2590065150 msgr2=0x7f2590067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2590065150 0x7f2590067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25a00016d0 tx=0x7f25a0009040 comp rx=0 tx=0).stop 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 msgr2=0x7f25b0159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b0159790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009f80 tx=0x7f25a8037000 comp rx=0 tx=0).stop 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 shutdown_connections 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2590065150 0x7f2590067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b0159350 0x7f25b0159790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b0158f80 0x7f25b00c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 --2- 172.21.15.149:0/2296657694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b00caa40 0x7f25b0155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 >> 172.21.15.149:0/2296657694 conn(0x7f25b00cfd90 msgr2=0x7f25b0068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 shutdown_connections 2024-08-17T02:46:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.485+0000 7f25b5e00640 1 -- 172.21.15.149:0/2296657694 wait complete. 2024-08-17T02:46:52.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:52.650 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.648+0000 7f8222600640 1 Processor -- start 2024-08-17T02:46:52.651 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.649+0000 7f8222600640 1 -- start start 2024-08-17T02:46:52.651 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8222600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f821c159ca0 0x7f821c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8222600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0cadc0 con 0x7f821c0ccca0 2024-08-17T02:46:52.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8222600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0cb060 con 0x7f821c0ca8a0 2024-08-17T02:46:52.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8222600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0cd6e0 con 0x7f821c159ca0 2024-08-17T02:46:52.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8221c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f821c0ccca0 0x7f821c162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35534/0 (socket says 172.21.15.149:35534) 2024-08-17T02:46:52.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8221c00640 1 -- 172.21.15.149:0/1670881005 learned_addr learned my addr 172.21.15.149:0/1670881005 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:52.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8221200640 1 --2- 172.21.15.149:0/1670881005 >> v2:172.21.15.161:3300/0 conn(0x7f821c159ca0 0x7f821c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f821be00640 1 -- 172.21.15.149:0/1670881005 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105987200 0 0) 0x7f821c0cadc0 con 0x7f821c0ccca0 2024-08-17T02:46:52.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f821be00640 1 -- 172.21.15.149:0/1670881005 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82000034e0 con 0x7f821c0ccca0 2024-08-17T02:46:52.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8221200640 1 -- 172.21.15.149:0/1670881005 >> v1:172.21.15.161:6789/0 conn(0x7f821c0ca8a0 legacy=0x7f821c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8221200640 1 -- 172.21.15.149:0/1670881005 >> v1:172.21.15.149:6789/0 conn(0x7f821c0ccca0 legacy=0x7f821c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.651+0000 7f8221200640 1 -- 172.21.15.149:0/1670881005 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0cb300 con 0x7f821c159ca0 2024-08-17T02:46:52.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.652+0000 7f8221200640 1 --2- 172.21.15.149:0/1670881005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0ca360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f820c009850 tx=0x7f820c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b9f78d256f61ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.652+0000 7f821be00640 1 -- 172.21.15.149:0/1670881005 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c02ae20 con 0x7f821c159ca0 2024-08-17T02:46:52.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.652+0000 7f821be00640 1 -- 172.21.15.149:0/1670881005 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c032440 con 0x7f821c159ca0 2024-08-17T02:46:52.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.652+0000 7f821be00640 1 -- 172.21.15.149:0/1670881005 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0327e0 con 0x7f821c159ca0 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.652+0000 7f8222600640 1 -- 172.21.15.149:0/1670881005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 msgr2=0x7f821c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.652+0000 7f8222600640 1 --2- 172.21.15.149:0/1670881005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0ca360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f820c009850 tx=0x7f820c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.653+0000 7f8222600640 1 -- 172.21.15.149:0/1670881005 shutdown_connections 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.653+0000 7f8222600640 1 --2- 172.21.15.149:0/1670881005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0ca360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.653+0000 7f8222600640 1 -- 172.21.15.149:0/1670881005 >> 172.21.15.149:0/1670881005 conn(0x7f821c098e00 msgr2=0x7f821c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.653+0000 7f8222600640 1 -- 172.21.15.149:0/1670881005 shutdown_connections 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.653+0000 7f8222600640 1 -- 172.21.15.149:0/1670881005 wait complete. 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.654+0000 7f8222600640 1 Processor -- start 2024-08-17T02:46:52.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.654+0000 7f8222600640 1 -- start start 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8222600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f821c0ca8a0 0x7f821c09a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8222600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 0x7f821c14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8222600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8222600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c3610 con 0x7f821c0ccca0 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8222600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c09b900 con 0x7f821c159ca0 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8222600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c09acf0 con 0x7f821c0ca8a0 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8213e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 0x7f821c14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8221200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f821c0ca8a0 0x7f821c09a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8213e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 0x7f821c14ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47960/0 (socket says 172.21.15.149:47960) 2024-08-17T02:46:52.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8213e00640 1 -- 172.21.15.149:0/3910411780 learned_addr learned my addr 172.21.15.149:0/3910411780 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:52.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.655+0000 7f8221c00640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8213e00640 1 -- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f821c0ca8a0 msgr2=0x7f821c09a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8213e00640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f821c0ca8a0 0x7f821c09a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8213e00640 1 -- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 msgr2=0x7f821c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8213e00640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8213e00640 1 -- 172.21.15.149:0/3910411780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c009390 con 0x7f821c0ccca0 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8213e00640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 0x7f821c14ced0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f820400c560 tx=0x7f8204007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204011590 con 0x7f821c0ccca0 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204011710 con 0x7f821c0ccca0 2024-08-17T02:46:52.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c09afd0 con 0x7f821c0ccca0 2024-08-17T02:46:52.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.656+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204011ad0 con 0x7f821c0ccca0 2024-08-17T02:46:52.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.657+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c09b590 con 0x7f821c0ccca0 2024-08-17T02:46:52.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.658+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c071050 con 0x7f821c0ccca0 2024-08-17T02:46:52.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.658+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f820401b3b0 con 0x7f821c0ccca0 2024-08-17T02:46:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.659+0000 7f8218c00640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f81f8065180 0x7f81f8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.659+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82040818e0 con 0x7f821c0ccca0 2024-08-17T02:46:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.660+0000 7f8221200640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f81f8065180 0x7f81f8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.660+0000 7f8221200640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f81f8065180 0x7f81f8067630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f820c034000 tx=0x7f820c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.663+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f820404fa50 con 0x7f821c0ccca0 2024-08-17T02:46:52.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.835+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f821c15ae00 con 0x7f821c0ccca0 2024-08-17T02:46:52.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.836+0000 7f8218c00640 1 -- 172.21.15.149:0/3910411780 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f8204017070 con 0x7f821c0ccca0 2024-08-17T02:46:52.838 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:52.838 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f81f8065180 msgr2=0x7f81f8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f81f8065180 0x7f81f8067630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f820c034000 tx=0x7f820c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 msgr2=0x7f821c14ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 0x7f821c14ced0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f820400c560 tx=0x7f8204007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 shutdown_connections 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f81f8065180 0x7f81f8067630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f821c159ca0 0x7f821c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c0ccca0 0x7f821c14ced0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 --2- 172.21.15.149:0/3910411780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f821c0ca8a0 0x7f821c09a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 >> 172.21.15.149:0/3910411780 conn(0x7f821c098e00 msgr2=0x7f821c156dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 shutdown_connections 2024-08-17T02:46:52.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:52.838+0000 7f8222600640 1 -- 172.21.15.149:0/3910411780 wait complete. 2024-08-17T02:46:52.856 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:46:52.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.003+0000 7f998f400640 1 Processor -- start 2024-08-17T02:46:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.003+0000 7f998f400640 1 -- start start 2024-08-17T02:46:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f998f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99880aa7d0 0x7f998806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f998f400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880a9a10 con 0x7f9988158fa0 2024-08-17T02:46:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f998f400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880a9cf0 con 0x7f998806da20 2024-08-17T02:46:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f998f400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880ac400 con 0x7f99880aa7d0 2024-08-17T02:46:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f997fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99880aa7d0 0x7f998806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f998d400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9988158fa0 0x7f99880ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35538/0 (socket says 172.21.15.149:35538) 2024-08-17T02:46:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f997fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99880aa7d0 0x7f998806ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47966/0 (socket says 172.21.15.149:47966) 2024-08-17T02:46:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f997fe00640 1 -- 172.21.15.149:0/615159157 learned_addr learned my addr 172.21.15.149:0/615159157 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f997fe00640 1 -- 172.21.15.149:0/615159157 >> v1:172.21.15.161:6789/0 conn(0x7f998806da20 legacy=0x7f9988158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f997fe00640 1 -- 172.21.15.149:0/615159157 >> v1:172.21.15.149:6789/0 conn(0x7f9988158fa0 legacy=0x7f99880ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.005+0000 7f997fe00640 1 -- 172.21.15.149:0/615159157 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880a9fd0 con 0x7f99880aa7d0 2024-08-17T02:46:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.006+0000 7f997fe00640 1 --2- 172.21.15.149:0/615159157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998806ddf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9970009910 tx=0x7f99700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1c10ebfcc70d4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.006+0000 7f9987e00640 1 -- 172.21.15.149:0/615159157 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997002ae60 con 0x7f99880aa7d0 2024-08-17T02:46:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f9987e00640 1 -- 172.21.15.149:0/615159157 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9970032440 con 0x7f99880aa7d0 2024-08-17T02:46:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f9987e00640 1 -- 172.21.15.149:0/615159157 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700327e0 con 0x7f99880aa7d0 2024-08-17T02:46:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 -- 172.21.15.149:0/615159157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 msgr2=0x7f998806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 --2- 172.21.15.149:0/615159157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998806ddf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9970009910 tx=0x7f99700091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 -- 172.21.15.149:0/615159157 shutdown_connections 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 --2- 172.21.15.149:0/615159157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998806ddf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 -- 172.21.15.149:0/615159157 >> 172.21.15.149:0/615159157 conn(0x7f99880cb9b0 msgr2=0x7f99880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 -- 172.21.15.149:0/615159157 shutdown_connections 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.007+0000 7f998f400640 1 -- 172.21.15.149:0/615159157 wait complete. 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.009+0000 7f998f400640 1 Processor -- start 2024-08-17T02:46:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.009+0000 7f998f400640 1 -- start start 2024-08-17T02:46:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998806da20 0x7f998814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998816c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9988158fa0 0x7f99880690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998814d360 con 0x7f99880aa7d0 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998806a850 con 0x7f998806da20 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998816d2a0 con 0x7f9988158fa0 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998816c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998816c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47972/0 (socket says 172.21.15.149:47972) 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 -- 172.21.15.149:0/2584154785 learned_addr learned my addr 172.21.15.149:0/2584154785 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998d400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9988158fa0 0x7f99880690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998ca00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998806da20 0x7f998814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 -- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9988158fa0 msgr2=0x7f99880690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9988158fa0 0x7f99880690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 -- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998806da20 msgr2=0x7f998814ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998806da20 0x7f998814ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 -- 172.21.15.149:0/2584154785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009450 con 0x7f99880aa7d0 2024-08-17T02:46:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998d400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9988158fa0 0x7f99880690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:53.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998ca00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998806da20 0x7f998814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:53.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f997fe00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998816c8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9970035040 tx=0x7f9970032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970031de0 con 0x7f99880aa7d0 2024-08-17T02:46:53.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997003d420 con 0x7f99880aa7d0 2024-08-17T02:46:53.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997003d7e0 con 0x7f99880aa7d0 2024-08-17T02:46:53.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998816d580 con 0x7f99880aa7d0 2024-08-17T02:46:53.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.011+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9988068b90 con 0x7f99880aa7d0 2024-08-17T02:46:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.012+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9988068dd0 con 0x7f99880aa7d0 2024-08-17T02:46:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.013+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9970039040 con 0x7f99880aa7d0 2024-08-17T02:46:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.014+0000 7f9984c00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9964065150 0x7f9964067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.014+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99700a2330 con 0x7f99880aa7d0 2024-08-17T02:46:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.014+0000 7f998ca00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9964065150 0x7f9964067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.015+0000 7f998ca00640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9964065150 0x7f9964067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9978001820 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.020 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.018+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9988068dd0 con 0x7f99880aa7d0 2024-08-17T02:46:53.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.190+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9988068730 con 0x7f9964065150 2024-08-17T02:46:53.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.198+0000 7f9984c00640 1 -- 172.21.15.149:0/2584154785 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264705 (secure 0 0 0) 0x7f9978001450 con 0x7f9964065150 2024-08-17T02:46:53.203 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:53.205 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9964065150 msgr2=0x7f9964067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9964065150 0x7f9964067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9978001820 tx=0x7f9978009040 comp rx=0 tx=0).stop 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 msgr2=0x7f998816c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998816c8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9970035040 tx=0x7f9970032000 comp rx=0 tx=0).stop 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 shutdown_connections 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9964065150 0x7f9964067600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9988158fa0 0x7f99880690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99880aa7d0 0x7f998816c8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.202+0000 7f998f400640 1 --2- 172.21.15.149:0/2584154785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998806da20 0x7f998814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.203+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 >> 172.21.15.149:0/2584154785 conn(0x7f99880cb9b0 msgr2=0x7f99880b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.203+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 shutdown_connections 2024-08-17T02:46:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.203+0000 7f998f400640 1 -- 172.21.15.149:0/2584154785 wait complete. 2024-08-17T02:46:53.219 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:46:51.625498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381764,"kb_used_data":2892,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592956,"statfs":{"total":773094113280,"available":770655186944,"internally_reserved":0,"allocated":2961408,"data_stored":1765876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572859"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087269+0000","last_change":"2024-08-17T02:46:49.087269+0000","last_active":"2024-08-17T02:46:49.087269+0000","last_peered":"2024-08-17T02:46:49.087269+0000","last_clean":"2024-08-17T02:46:49.087269+0000","last_became_active":"2024-08-17T02:46:49.086977+0000","last_became_peered":"2024-08-17T02:46:49.086977+0000","last_unstale":"2024-08-17T02:46:49.087269+0000","last_undegraded":"2024-08-17T02:46:49.087269+0000","last_fullsized":"2024-08-17T02:46:49.087269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095362+0000","last_change":"2024-08-17T02:46:49.092074+0000","last_active":"2024-08-17T02:46:49.095362+0000","last_peered":"2024-08-17T02:46:49.095362+0000","last_clean":"2024-08-17T02:46:49.095362+0000","last_became_active":"2024-08-17T02:46:49.090161+0000","last_became_peered":"2024-08-17T02:46:49.090161+0000","last_unstale":"2024-08-17T02:46:49.095362+0000","last_undegraded":"2024-08-17T02:46:49.095362+0000","last_fullsized":"2024-08-17T02:46:49.095362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086579+0000","last_change":"2024-08-17T02:46:49.086579+0000","last_active":"2024-08-17T02:46:49.086579+0000","last_peered":"2024-08-17T02:46:49.086579+0000","last_clean":"2024-08-17T02:46:49.086579+0000","last_became_active":"2024-08-17T02:46:49.084975+0000","last_became_peered":"2024-08-17T02:46:49.084975+0000","last_unstale":"2024-08-17T02:46:49.086579+0000","last_undegraded":"2024-08-17T02:46:49.086579+0000","last_fullsized":"2024-08-17T02:46:49.086579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096542+0000","last_change":"2024-08-17T02:46:49.094697+0000","last_active":"2024-08-17T02:46:49.096542+0000","last_peered":"2024-08-17T02:46:49.096542+0000","last_clean":"2024-08-17T02:46:49.096542+0000","last_became_active":"2024-08-17T02:46:49.093541+0000","last_became_peered":"2024-08-17T02:46:49.093541+0000","last_unstale":"2024-08-17T02:46:49.096542+0000","last_undegraded":"2024-08-17T02:46:49.096542+0000","last_fullsized":"2024-08-17T02:46:49.096542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082685+0000","last_change":"2024-08-17T02:46:49.082685+0000","last_active":"2024-08-17T02:46:49.082685+0000","last_peered":"2024-08-17T02:46:49.082685+0000","last_clean":"2024-08-17T02:46:49.082685+0000","last_became_active":"2024-08-17T02:46:49.082382+0000","last_became_peered":"2024-08-17T02:46:49.082382+0000","last_unstale":"2024-08-17T02:46:49.082685+0000","last_undegraded":"2024-08-17T02:46:49.082685+0000","last_fullsized":"2024-08-17T02:46:49.082685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097478+0000","last_change":"2024-08-17T02:46:49.096292+0000","last_active":"2024-08-17T02:46:49.097478+0000","last_peered":"2024-08-17T02:46:49.097478+0000","last_clean":"2024-08-17T02:46:49.097478+0000","last_became_active":"2024-08-17T02:46:49.096030+0000","last_became_peered":"2024-08-17T02:46:49.096030+0000","last_unstale":"2024-08-17T02:46:49.097478+0000","last_undegraded":"2024-08-17T02:46:49.097478+0000","last_fullsized":"2024-08-17T02:46:49.097478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096389+0000","last_change":"2024-08-17T02:46:49.096389+0000","last_active":"2024-08-17T02:46:49.096389+0000","last_peered":"2024-08-17T02:46:49.096389+0000","last_clean":"2024-08-17T02:46:49.096389+0000","last_became_active":"2024-08-17T02:46:49.095461+0000","last_became_peered":"2024-08-17T02:46:49.095461+0000","last_unstale":"2024-08-17T02:46:49.096389+0000","last_undegraded":"2024-08-17T02:46:49.096389+0000","last_fullsized":"2024-08-17T02:46:49.096389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087502+0000","last_change":"2024-08-17T02:46:49.080927+0000","last_active":"2024-08-17T02:46:49.087502+0000","last_peered":"2024-08-17T02:46:49.087502+0000","last_clean":"2024-08-17T02:46:49.087502+0000","last_became_active":"2024-08-17T02:46:49.080697+0000","last_became_peered":"2024-08-17T02:46:49.080697+0000","last_unstale":"2024-08-17T02:46:49.087502+0000","last_undegraded":"2024-08-17T02:46:49.087502+0000","last_fullsized":"2024-08-17T02:46:49.087502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:02.889606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.101464+0000","last_change":"2024-08-17T02:46:49.101464+0000","last_active":"2024-08-17T02:46:49.101464+0000","last_peered":"2024-08-17T02:46:49.101464+0000","last_clean":"2024-08-17T02:46:49.101464+0000","last_became_active":"2024-08-17T02:46:49.100349+0000","last_became_peered":"2024-08-17T02:46:49.100349+0000","last_unstale":"2024-08-17T02:46:49.101464+0000","last_undegraded":"2024-08-17T02:46:49.101464+0000","last_fullsized":"2024-08-17T02:46:49.101464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104176+0000","last_change":"2024-08-17T02:46:49.104176+0000","last_active":"2024-08-17T02:46:49.104176+0000","last_peered":"2024-08-17T02:46:49.104176+0000","last_clean":"2024-08-17T02:46:49.104176+0000","last_became_active":"2024-08-17T02:46:49.095015+0000","last_became_peered":"2024-08-17T02:46:49.095015+0000","last_unstale":"2024-08-17T02:46:49.104176+0000","last_undegraded":"2024-08-17T02:46:49.104176+0000","last_fullsized":"2024-08-17T02:46:49.104176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082956+0000","last_change":"2024-08-17T02:46:49.082956+0000","last_active":"2024-08-17T02:46:49.082956+0000","last_peered":"2024-08-17T02:46:49.082956+0000","last_clean":"2024-08-17T02:46:49.082956+0000","last_became_active":"2024-08-17T02:46:49.080315+0000","last_became_peered":"2024-08-17T02:46:49.080315+0000","last_unstale":"2024-08-17T02:46:49.082956+0000","last_undegraded":"2024-08-17T02:46:49.082956+0000","last_fullsized":"2024-08-17T02:46:49.082956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.106327+0000","last_change":"2024-08-17T02:46:49.106327+0000","last_active":"2024-08-17T02:46:49.106327+0000","last_peered":"2024-08-17T02:46:49.106327+0000","last_clean":"2024-08-17T02:46:49.106327+0000","last_became_active":"2024-08-17T02:46:49.105995+0000","last_became_peered":"2024-08-17T02:46:49.105995+0000","last_unstale":"2024-08-17T02:46:49.106327+0000","last_undegraded":"2024-08-17T02:46:49.106327+0000","last_fullsized":"2024-08-17T02:46:49.106327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:20.150470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100233+0000","last_change":"2024-08-17T02:46:49.088848+0000","last_active":"2024-08-17T02:46:49.100233+0000","last_peered":"2024-08-17T02:46:49.100233+0000","last_clean":"2024-08-17T02:46:49.100233+0000","last_became_active":"2024-08-17T02:46:49.088404+0000","last_became_peered":"2024-08-17T02:46:49.088404+0000","last_unstale":"2024-08-17T02:46:49.100233+0000","last_undegraded":"2024-08-17T02:46:49.100233+0000","last_fullsized":"2024-08-17T02:46:49.100233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.074941+0000","last_change":"2024-08-17T02:46:49.074941+0000","last_active":"2024-08-17T02:46:49.074941+0000","last_peered":"2024-08-17T02:46:49.074941+0000","last_clean":"2024-08-17T02:46:49.074941+0000","last_became_active":"2024-08-17T02:46:49.074163+0000","last_became_peered":"2024-08-17T02:46:49.074163+0000","last_unstale":"2024-08-17T02:46:49.074941+0000","last_undegraded":"2024-08-17T02:46:49.074941+0000","last_fullsized":"2024-08-17T02:46:49.074941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086626+0000","last_change":"2024-08-17T02:46:49.081496+0000","last_active":"2024-08-17T02:46:49.086626+0000","last_peered":"2024-08-17T02:46:49.086626+0000","last_clean":"2024-08-17T02:46:49.086626+0000","last_became_active":"2024-08-17T02:46:49.081271+0000","last_became_peered":"2024-08-17T02:46:49.081271+0000","last_unstale":"2024-08-17T02:46:49.086626+0000","last_undegraded":"2024-08-17T02:46:49.086626+0000","last_fullsized":"2024-08-17T02:46:49.086626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079182+0000","last_change":"2024-08-17T02:46:49.075960+0000","last_active":"2024-08-17T02:46:49.079182+0000","last_peered":"2024-08-17T02:46:49.079182+0000","last_clean":"2024-08-17T02:46:49.079182+0000","last_became_active":"2024-08-17T02:46:49.075702+0000","last_became_peered":"2024-08-17T02:46:49.075702+0000","last_unstale":"2024-08-17T02:46:49.079182+0000","last_undegraded":"2024-08-17T02:46:49.079182+0000","last_fullsized":"2024-08-17T02:46:49.079182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093082+0000","last_change":"2024-08-17T02:46:49.090727+0000","last_active":"2024-08-17T02:46:49.093082+0000","last_peered":"2024-08-17T02:46:49.093082+0000","last_clean":"2024-08-17T02:46:49.093082+0000","last_became_active":"2024-08-17T02:46:49.090098+0000","last_became_peered":"2024-08-17T02:46:49.090098+0000","last_unstale":"2024-08-17T02:46:49.093082+0000","last_undegraded":"2024-08-17T02:46:49.093082+0000","last_fullsized":"2024-08-17T02:46:49.093082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092750+0000","last_change":"2024-08-17T02:46:49.090463+0000","last_active":"2024-08-17T02:46:49.092750+0000","last_peered":"2024-08-17T02:46:49.092750+0000","last_clean":"2024-08-17T02:46:49.092750+0000","last_became_active":"2024-08-17T02:46:49.090190+0000","last_became_peered":"2024-08-17T02:46:49.090190+0000","last_unstale":"2024-08-17T02:46:49.092750+0000","last_undegraded":"2024-08-17T02:46:49.092750+0000","last_fullsized":"2024-08-17T02:46:49.092750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:29.020704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.090958+0000","last_change":"2024-08-17T02:46:49.090958+0000","last_active":"2024-08-17T02:46:49.090958+0000","last_peered":"2024-08-17T02:46:49.090958+0000","last_clean":"2024-08-17T02:46:49.090958+0000","last_became_active":"2024-08-17T02:46:49.089995+0000","last_became_peered":"2024-08-17T02:46:49.089995+0000","last_unstale":"2024-08-17T02:46:49.090958+0000","last_undegraded":"2024-08-17T02:46:49.090958+0000","last_fullsized":"2024-08-17T02:46:49.090958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087791+0000","last_change":"2024-08-17T02:46:49.087791+0000","last_active":"2024-08-17T02:46:49.087791+0000","last_peered":"2024-08-17T02:46:49.087791+0000","last_clean":"2024-08-17T02:46:49.087791+0000","last_became_active":"2024-08-17T02:46:49.087472+0000","last_became_peered":"2024-08-17T02:46:49.087472+0000","last_unstale":"2024-08-17T02:46:49.087791+0000","last_undegraded":"2024-08-17T02:46:49.087791+0000","last_fullsized":"2024-08-17T02:46:49.087791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094327+0000","last_change":"2024-08-17T02:46:49.094327+0000","last_active":"2024-08-17T02:46:49.094327+0000","last_peered":"2024-08-17T02:46:49.094327+0000","last_clean":"2024-08-17T02:46:49.094327+0000","last_became_active":"2024-08-17T02:46:49.087534+0000","last_became_peered":"2024-08-17T02:46:49.087534+0000","last_unstale":"2024-08-17T02:46:49.094327+0000","last_undegraded":"2024-08-17T02:46:49.094327+0000","last_fullsized":"2024-08-17T02:46:49.094327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092779+0000","last_change":"2024-08-17T02:46:49.086507+0000","last_active":"2024-08-17T02:46:49.092779+0000","last_peered":"2024-08-17T02:46:49.092779+0000","last_clean":"2024-08-17T02:46:49.092779+0000","last_became_active":"2024-08-17T02:46:49.086187+0000","last_became_peered":"2024-08-17T02:46:49.086187+0000","last_unstale":"2024-08-17T02:46:49.092779+0000","last_undegraded":"2024-08-17T02:46:49.092779+0000","last_fullsized":"2024-08-17T02:46:49.092779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093374+0000","last_change":"2024-08-17T02:46:49.087201+0000","last_active":"2024-08-17T02:46:49.093374+0000","last_peered":"2024-08-17T02:46:49.093374+0000","last_clean":"2024-08-17T02:46:49.093374+0000","last_became_active":"2024-08-17T02:46:49.086903+0000","last_became_peered":"2024-08-17T02:46:49.086903+0000","last_unstale":"2024-08-17T02:46:49.093374+0000","last_undegraded":"2024-08-17T02:46:49.093374+0000","last_fullsized":"2024-08-17T02:46:49.093374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:13.388708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093050+0000","last_change":"2024-08-17T02:46:49.084845+0000","last_active":"2024-08-17T02:46:49.093050+0000","last_peered":"2024-08-17T02:46:49.093050+0000","last_clean":"2024-08-17T02:46:49.093050+0000","last_became_active":"2024-08-17T02:46:49.084208+0000","last_became_peered":"2024-08-17T02:46:49.084208+0000","last_unstale":"2024-08-17T02:46:49.093050+0000","last_undegraded":"2024-08-17T02:46:49.093050+0000","last_fullsized":"2024-08-17T02:46:49.093050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100172+0000","last_change":"2024-08-17T02:46:49.088034+0000","last_active":"2024-08-17T02:46:49.100172+0000","last_peered":"2024-08-17T02:46:49.100172+0000","last_clean":"2024-08-17T02:46:49.100172+0000","last_became_active":"2024-08-17T02:46:49.085634+0000","last_became_peered":"2024-08-17T02:46:49.085634+0000","last_unstale":"2024-08-17T02:46:49.100172+0000","last_undegraded":"2024-08-17T02:46:49.100172+0000","last_fullsized":"2024-08-17T02:46:49.100172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:13.489732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093914+0000","last_change":"2024-08-17T02:46:49.093914+0000","last_active":"2024-08-17T02:46:49.093914+0000","last_peered":"2024-08-17T02:46:49.093914+0000","last_clean":"2024-08-17T02:46:49.093914+0000","last_became_active":"2024-08-17T02:46:49.093612+0000","last_became_peered":"2024-08-17T02:46:49.093612+0000","last_unstale":"2024-08-17T02:46:49.093914+0000","last_undegraded":"2024-08-17T02:46:49.093914+0000","last_fullsized":"2024-08-17T02:46:49.093914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094706+0000","last_change":"2024-08-17T02:46:49.091029+0000","last_active":"2024-08-17T02:46:49.094706+0000","last_peered":"2024-08-17T02:46:49.094706+0000","last_clean":"2024-08-17T02:46:49.094706+0000","last_became_active":"2024-08-17T02:46:49.090798+0000","last_became_peered":"2024-08-17T02:46:49.090798+0000","last_unstale":"2024-08-17T02:46:49.094706+0000","last_undegraded":"2024-08-17T02:46:49.094706+0000","last_fullsized":"2024-08-17T02:46:49.094706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103306+0000","last_change":"2024-08-17T02:46:49.097976+0000","last_active":"2024-08-17T02:46:49.103306+0000","last_peered":"2024-08-17T02:46:49.103306+0000","last_clean":"2024-08-17T02:46:49.103306+0000","last_became_active":"2024-08-17T02:46:49.095177+0000","last_became_peered":"2024-08-17T02:46:49.095177+0000","last_unstale":"2024-08-17T02:46:49.103306+0000","last_undegraded":"2024-08-17T02:46:49.103306+0000","last_fullsized":"2024-08-17T02:46:49.103306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.269002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094891+0000","last_change":"2024-08-17T02:46:49.094891+0000","last_active":"2024-08-17T02:46:49.094891+0000","last_peered":"2024-08-17T02:46:49.094891+0000","last_clean":"2024-08-17T02:46:49.094891+0000","last_became_active":"2024-08-17T02:46:49.094626+0000","last_became_peered":"2024-08-17T02:46:49.094626+0000","last_unstale":"2024-08-17T02:46:49.094891+0000","last_undegraded":"2024-08-17T02:46:49.094891+0000","last_fullsized":"2024-08-17T02:46:49.094891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092753+0000","last_change":"2024-08-17T02:46:49.085872+0000","last_active":"2024-08-17T02:46:49.092753+0000","last_peered":"2024-08-17T02:46:49.092753+0000","last_clean":"2024-08-17T02:46:49.092753+0000","last_became_active":"2024-08-17T02:46:49.085620+0000","last_became_peered":"2024-08-17T02:46:49.085620+0000","last_unstale":"2024-08-17T02:46:49.092753+0000","last_undegraded":"2024-08-17T02:46:49.092753+0000","last_fullsized":"2024-08-17T02:46:49.092753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087104+0000","last_change":"2024-08-17T02:46:49.079133+0000","last_active":"2024-08-17T02:46:49.087104+0000","last_peered":"2024-08-17T02:46:49.087104+0000","last_clean":"2024-08-17T02:46:49.087104+0000","last_became_active":"2024-08-17T02:46:49.078405+0000","last_became_peered":"2024-08-17T02:46:49.078405+0000","last_unstale":"2024-08-17T02:46:49.087104+0000","last_undegraded":"2024-08-17T02:46:49.087104+0000","last_fullsized":"2024-08-17T02:46:49.087104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:57.922654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105591+0000","last_change":"2024-08-17T02:46:49.105591+0000","last_active":"2024-08-17T02:46:49.105591+0000","last_peered":"2024-08-17T02:46:49.105591+0000","last_clean":"2024-08-17T02:46:49.105591+0000","last_became_active":"2024-08-17T02:46:49.104220+0000","last_became_peered":"2024-08-17T02:46:49.104220+0000","last_unstale":"2024-08-17T02:46:49.105591+0000","last_undegraded":"2024-08-17T02:46:49.105591+0000","last_fullsized":"2024-08-17T02:46:49.105591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.072690+0000","last_change":"2024-08-17T02:46:49.072690+0000","last_active":"2024-08-17T02:46:49.072690+0000","last_peered":"2024-08-17T02:46:49.072690+0000","last_clean":"2024-08-17T02:46:49.072690+0000","last_became_active":"2024-08-17T02:46:49.072424+0000","last_became_peered":"2024-08-17T02:46:49.072424+0000","last_unstale":"2024-08-17T02:46:49.072690+0000","last_undegraded":"2024-08-17T02:46:49.072690+0000","last_fullsized":"2024-08-17T02:46:49.072690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:35.318940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099753+0000","last_change":"2024-08-17T02:46:48.085210+0000","last_active":"2024-08-17T02:46:49.099753+0000","last_peered":"2024-08-17T02:46:49.099753+0000","last_clean":"2024-08-17T02:46:49.099753+0000","last_became_active":"2024-08-17T02:46:48.084916+0000","last_became_peered":"2024-08-17T02:46:48.084916+0000","last_unstale":"2024-08-17T02:46:49.099753+0000","last_undegraded":"2024-08-17T02:46:49.099753+0000","last_fullsized":"2024-08-17T02:46:49.099753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080439+0000","last_change":"2024-08-17T02:46:49.080439+0000","last_active":"2024-08-17T02:46:49.080439+0000","last_peered":"2024-08-17T02:46:49.080439+0000","last_clean":"2024-08-17T02:46:49.080439+0000","last_became_active":"2024-08-17T02:46:49.080211+0000","last_became_peered":"2024-08-17T02:46:49.080211+0000","last_unstale":"2024-08-17T02:46:49.080439+0000","last_undegraded":"2024-08-17T02:46:49.080439+0000","last_fullsized":"2024-08-17T02:46:49.080439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.072519+0000","last_change":"2024-08-17T02:46:48.090901+0000","last_active":"2024-08-17T02:46:49.072519+0000","last_peered":"2024-08-17T02:46:49.072519+0000","last_clean":"2024-08-17T02:46:49.072519+0000","last_became_active":"2024-08-17T02:46:48.089868+0000","last_became_peered":"2024-08-17T02:46:48.089868+0000","last_unstale":"2024-08-17T02:46:49.072519+0000","last_undegraded":"2024-08-17T02:46:49.072519+0000","last_fullsized":"2024-08-17T02:46:49.072519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079910+0000","last_change":"2024-08-17T02:46:48.076568+0000","last_active":"2024-08-17T02:46:49.079910+0000","last_peered":"2024-08-17T02:46:49.079910+0000","last_clean":"2024-08-17T02:46:49.079910+0000","last_became_active":"2024-08-17T02:46:48.076238+0000","last_became_peered":"2024-08-17T02:46:48.076238+0000","last_unstale":"2024-08-17T02:46:49.079910+0000","last_undegraded":"2024-08-17T02:46:49.079910+0000","last_fullsized":"2024-08-17T02:46:49.079910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103277+0000","last_change":"2024-08-17T02:46:49.095963+0000","last_active":"2024-08-17T02:46:49.103277+0000","last_peered":"2024-08-17T02:46:49.103277+0000","last_clean":"2024-08-17T02:46:49.103277+0000","last_became_active":"2024-08-17T02:46:49.095697+0000","last_became_peered":"2024-08-17T02:46:49.095697+0000","last_unstale":"2024-08-17T02:46:49.103277+0000","last_undegraded":"2024-08-17T02:46:49.103277+0000","last_fullsized":"2024-08-17T02:46:49.103277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066816+0000","last_change":"2024-08-17T02:46:48.090123+0000","last_active":"2024-08-17T02:46:49.066816+0000","last_peered":"2024-08-17T02:46:49.066816+0000","last_clean":"2024-08-17T02:46:49.066816+0000","last_became_active":"2024-08-17T02:46:48.089137+0000","last_became_peered":"2024-08-17T02:46:48.089137+0000","last_unstale":"2024-08-17T02:46:49.066816+0000","last_undegraded":"2024-08-17T02:46:49.066816+0000","last_fullsized":"2024-08-17T02:46:49.066816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094584+0000","last_change":"2024-08-17T02:46:49.086912+0000","last_active":"2024-08-17T02:46:49.094584+0000","last_peered":"2024-08-17T02:46:49.094584+0000","last_clean":"2024-08-17T02:46:49.094584+0000","last_became_active":"2024-08-17T02:46:49.086607+0000","last_became_peered":"2024-08-17T02:46:49.086607+0000","last_unstale":"2024-08-17T02:46:49.094584+0000","last_undegraded":"2024-08-17T02:46:49.094584+0000","last_fullsized":"2024-08-17T02:46:49.094584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.084276+0000","last_change":"2024-08-17T02:46:48.082227+0000","last_active":"2024-08-17T02:46:48.084276+0000","last_peered":"2024-08-17T02:46:48.084276+0000","last_clean":"2024-08-17T02:46:48.084276+0000","last_became_active":"2024-08-17T02:46:48.081670+0000","last_became_peered":"2024-08-17T02:46:48.081670+0000","last_unstale":"2024-08-17T02:46:48.084276+0000","last_undegraded":"2024-08-17T02:46:48.084276+0000","last_fullsized":"2024-08-17T02:46:48.084276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093016+0000","last_change":"2024-08-17T02:46:49.089798+0000","last_active":"2024-08-17T02:46:49.093016+0000","last_peered":"2024-08-17T02:46:49.093016+0000","last_clean":"2024-08-17T02:46:49.093016+0000","last_became_active":"2024-08-17T02:46:49.088859+0000","last_became_peered":"2024-08-17T02:46:49.088859+0000","last_unstale":"2024-08-17T02:46:49.093016+0000","last_undegraded":"2024-08-17T02:46:49.093016+0000","last_fullsized":"2024-08-17T02:46:49.093016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.067403+0000","last_change":"2024-08-17T02:46:48.075698+0000","last_active":"2024-08-17T02:46:49.067403+0000","last_peered":"2024-08-17T02:46:49.067403+0000","last_clean":"2024-08-17T02:46:49.067403+0000","last_became_active":"2024-08-17T02:46:48.075409+0000","last_became_peered":"2024-08-17T02:46:48.075409+0000","last_unstale":"2024-08-17T02:46:49.067403+0000","last_undegraded":"2024-08-17T02:46:49.067403+0000","last_fullsized":"2024-08-17T02:46:49.067403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.090547+0000","last_change":"2024-08-17T02:46:49.090547+0000","last_active":"2024-08-17T02:46:49.090547+0000","last_peered":"2024-08-17T02:46:49.090547+0000","last_clean":"2024-08-17T02:46:49.090547+0000","last_became_active":"2024-08-17T02:46:49.090316+0000","last_became_peered":"2024-08-17T02:46:49.090316+0000","last_unstale":"2024-08-17T02:46:49.090547+0000","last_undegraded":"2024-08-17T02:46:49.090547+0000","last_fullsized":"2024-08-17T02:46:49.090547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097432+0000","last_change":"2024-08-17T02:46:48.079760+0000","last_active":"2024-08-17T02:46:49.097432+0000","last_peered":"2024-08-17T02:46:49.097432+0000","last_clean":"2024-08-17T02:46:49.097432+0000","last_became_active":"2024-08-17T02:46:48.079517+0000","last_became_peered":"2024-08-17T02:46:48.079517+0000","last_unstale":"2024-08-17T02:46:49.097432+0000","last_undegraded":"2024-08-17T02:46:49.097432+0000","last_fullsized":"2024-08-17T02:46:49.097432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:10:17.014457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.091777+0000","last_change":"2024-08-17T02:46:49.091777+0000","last_active":"2024-08-17T02:46:49.091777+0000","last_peered":"2024-08-17T02:46:49.091777+0000","last_clean":"2024-08-17T02:46:49.091777+0000","last_became_active":"2024-08-17T02:46:49.085179+0000","last_became_peered":"2024-08-17T02:46:49.085179+0000","last_unstale":"2024-08-17T02:46:49.091777+0000","last_undegraded":"2024-08-17T02:46:49.091777+0000","last_fullsized":"2024-08-17T02:46:49.091777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:28.274012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.111677+0000","last_change":"2024-08-17T02:46:48.080838+0000","last_active":"2024-08-17T02:46:49.111677+0000","last_peered":"2024-08-17T02:46:49.111677+0000","last_clean":"2024-08-17T02:46:49.111677+0000","last_became_active":"2024-08-17T02:46:48.080291+0000","last_became_peered":"2024-08-17T02:46:48.080291+0000","last_unstale":"2024-08-17T02:46:49.111677+0000","last_undegraded":"2024-08-17T02:46:49.111677+0000","last_fullsized":"2024-08-17T02:46:49.111677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.088724+0000","last_change":"2024-08-17T02:46:49.088724+0000","last_active":"2024-08-17T02:46:49.088724+0000","last_peered":"2024-08-17T02:46:49.088724+0000","last_clean":"2024-08-17T02:46:49.088724+0000","last_became_active":"2024-08-17T02:46:49.088123+0000","last_became_peered":"2024-08-17T02:46:49.088123+0000","last_unstale":"2024-08-17T02:46:49.088724+0000","last_undegraded":"2024-08-17T02:46:49.088724+0000","last_fullsized":"2024-08-17T02:46:49.088724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.102289+0000","last_change":"2024-08-17T02:46:48.091037+0000","last_active":"2024-08-17T02:46:49.102289+0000","last_peered":"2024-08-17T02:46:49.102289+0000","last_clean":"2024-08-17T02:46:49.102289+0000","last_became_active":"2024-08-17T02:46:48.090779+0000","last_became_peered":"2024-08-17T02:46:48.090779+0000","last_unstale":"2024-08-17T02:46:49.102289+0000","last_undegraded":"2024-08-17T02:46:49.102289+0000","last_fullsized":"2024-08-17T02:46:49.102289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.089937+0000","last_change":"2024-08-17T02:46:49.089937+0000","last_active":"2024-08-17T02:46:49.089937+0000","last_peered":"2024-08-17T02:46:49.089937+0000","last_clean":"2024-08-17T02:46:49.089937+0000","last_became_active":"2024-08-17T02:46:49.089635+0000","last_became_peered":"2024-08-17T02:46:49.089635+0000","last_unstale":"2024-08-17T02:46:49.089937+0000","last_undegraded":"2024-08-17T02:46:49.089937+0000","last_fullsized":"2024-08-17T02:46:49.089937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068360+0000","last_change":"2024-08-17T02:46:48.078674+0000","last_active":"2024-08-17T02:46:49.068360+0000","last_peered":"2024-08-17T02:46:49.068360+0000","last_clean":"2024-08-17T02:46:49.068360+0000","last_became_active":"2024-08-17T02:46:48.078254+0000","last_became_peered":"2024-08-17T02:46:48.078254+0000","last_unstale":"2024-08-17T02:46:49.068360+0000","last_undegraded":"2024-08-17T02:46:49.068360+0000","last_fullsized":"2024-08-17T02:46:49.068360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083382+0000","last_change":"2024-08-17T02:46:49.083382+0000","last_active":"2024-08-17T02:46:49.083382+0000","last_peered":"2024-08-17T02:46:49.083382+0000","last_clean":"2024-08-17T02:46:49.083382+0000","last_became_active":"2024-08-17T02:46:49.083117+0000","last_became_peered":"2024-08-17T02:46:49.083117+0000","last_unstale":"2024-08-17T02:46:49.083382+0000","last_undegraded":"2024-08-17T02:46:49.083382+0000","last_fullsized":"2024-08-17T02:46:49.083382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.092769+0000","last_change":"2024-08-17T02:46:48.090201+0000","last_active":"2024-08-17T02:46:48.092769+0000","last_peered":"2024-08-17T02:46:48.092769+0000","last_clean":"2024-08-17T02:46:48.092769+0000","last_became_active":"2024-08-17T02:46:48.088890+0000","last_became_peered":"2024-08-17T02:46:48.088890+0000","last_unstale":"2024-08-17T02:46:48.092769+0000","last_undegraded":"2024-08-17T02:46:48.092769+0000","last_fullsized":"2024-08-17T02:46:48.092769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:52.864560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105595+0000","last_change":"2024-08-17T02:46:49.105595+0000","last_active":"2024-08-17T02:46:49.105595+0000","last_peered":"2024-08-17T02:46:49.105595+0000","last_clean":"2024-08-17T02:46:49.105595+0000","last_became_active":"2024-08-17T02:46:49.104413+0000","last_became_peered":"2024-08-17T02:46:49.104413+0000","last_unstale":"2024-08-17T02:46:49.105595+0000","last_undegraded":"2024-08-17T02:46:49.105595+0000","last_fullsized":"2024-08-17T02:46:49.105595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096457+0000","last_change":"2024-08-17T02:46:48.078982+0000","last_active":"2024-08-17T02:46:49.096457+0000","last_peered":"2024-08-17T02:46:49.096457+0000","last_clean":"2024-08-17T02:46:49.096457+0000","last_became_active":"2024-08-17T02:46:48.078749+0000","last_became_peered":"2024-08-17T02:46:48.078749+0000","last_unstale":"2024-08-17T02:46:49.096457+0000","last_undegraded":"2024-08-17T02:46:49.096457+0000","last_fullsized":"2024-08-17T02:46:49.096457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082500+0000","last_change":"2024-08-17T02:46:49.082500+0000","last_active":"2024-08-17T02:46:49.082500+0000","last_peered":"2024-08-17T02:46:49.082500+0000","last_clean":"2024-08-17T02:46:49.082500+0000","last_became_active":"2024-08-17T02:46:49.081473+0000","last_became_peered":"2024-08-17T02:46:49.081473+0000","last_unstale":"2024-08-17T02:46:49.082500+0000","last_undegraded":"2024-08-17T02:46:49.082500+0000","last_fullsized":"2024-08-17T02:46:49.082500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068223+0000","last_change":"2024-08-17T02:46:48.087651+0000","last_active":"2024-08-17T02:46:49.068223+0000","last_peered":"2024-08-17T02:46:49.068223+0000","last_clean":"2024-08-17T02:46:49.068223+0000","last_became_active":"2024-08-17T02:46:48.086669+0000","last_became_peered":"2024-08-17T02:46:48.086669+0000","last_unstale":"2024-08-17T02:46:49.068223+0000","last_undegraded":"2024-08-17T02:46:49.068223+0000","last_fullsized":"2024-08-17T02:46:49.068223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:51.853156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083492+0000","last_change":"2024-08-17T02:46:49.083492+0000","last_active":"2024-08-17T02:46:49.083492+0000","last_peered":"2024-08-17T02:46:49.083492+0000","last_clean":"2024-08-17T02:46:49.083492+0000","last_became_active":"2024-08-17T02:46:49.083219+0000","last_became_peered":"2024-08-17T02:46:49.083219+0000","last_unstale":"2024-08-17T02:46:49.083492+0000","last_undegraded":"2024-08-17T02:46:49.083492+0000","last_fullsized":"2024-08-17T02:46:49.083492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087839+0000","last_change":"2024-08-17T02:46:48.077491+0000","last_active":"2024-08-17T02:46:49.087839+0000","last_peered":"2024-08-17T02:46:49.087839+0000","last_clean":"2024-08-17T02:46:49.087839+0000","last_became_active":"2024-08-17T02:46:48.076811+0000","last_became_peered":"2024-08-17T02:46:48.076811+0000","last_unstale":"2024-08-17T02:46:49.087839+0000","last_undegraded":"2024-08-17T02:46:49.087839+0000","last_fullsized":"2024-08-17T02:46:49.087839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.101717+0000","last_change":"2024-08-17T02:46:49.101717+0000","last_active":"2024-08-17T02:46:49.101717+0000","last_peered":"2024-08-17T02:46:49.101717+0000","last_clean":"2024-08-17T02:46:49.101717+0000","last_became_active":"2024-08-17T02:46:49.101402+0000","last_became_peered":"2024-08-17T02:46:49.101402+0000","last_unstale":"2024-08-17T02:46:49.101717+0000","last_undegraded":"2024-08-17T02:46:49.101717+0000","last_fullsized":"2024-08-17T02:46:49.101717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:31.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097911+0000","last_change":"2024-08-17T02:46:48.088763+0000","last_active":"2024-08-17T02:46:49.097911+0000","last_peered":"2024-08-17T02:46:49.097911+0000","last_clean":"2024-08-17T02:46:49.097911+0000","last_became_active":"2024-08-17T02:46:48.088515+0000","last_became_peered":"2024-08-17T02:46:48.088515+0000","last_unstale":"2024-08-17T02:46:49.097911+0000","last_undegraded":"2024-08-17T02:46:49.097911+0000","last_fullsized":"2024-08-17T02:46:49.097911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:47.407554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095108+0000","last_change":"2024-08-17T02:46:49.091638+0000","last_active":"2024-08-17T02:46:49.095108+0000","last_peered":"2024-08-17T02:46:49.095108+0000","last_clean":"2024-08-17T02:46:49.095108+0000","last_became_active":"2024-08-17T02:46:49.091395+0000","last_became_peered":"2024-08-17T02:46:49.091395+0000","last_unstale":"2024-08-17T02:46:49.095108+0000","last_undegraded":"2024-08-17T02:46:49.095108+0000","last_fullsized":"2024-08-17T02:46:49.095108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071417+0000","last_change":"2024-08-17T02:46:48.081129+0000","last_active":"2024-08-17T02:46:49.071417+0000","last_peered":"2024-08-17T02:46:49.071417+0000","last_clean":"2024-08-17T02:46:49.071417+0000","last_became_active":"2024-08-17T02:46:48.080849+0000","last_became_peered":"2024-08-17T02:46:48.080849+0000","last_unstale":"2024-08-17T02:46:49.071417+0000","last_undegraded":"2024-08-17T02:46:49.071417+0000","last_fullsized":"2024-08-17T02:46:49.071417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:37.122554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100757+0000","last_change":"2024-08-17T02:46:49.100757+0000","last_active":"2024-08-17T02:46:49.100757+0000","last_peered":"2024-08-17T02:46:49.100757+0000","last_clean":"2024-08-17T02:46:49.100757+0000","last_became_active":"2024-08-17T02:46:49.100157+0000","last_became_peered":"2024-08-17T02:46:49.100157+0000","last_unstale":"2024-08-17T02:46:49.100757+0000","last_undegraded":"2024-08-17T02:46:49.100757+0000","last_fullsized":"2024-08-17T02:46:49.100757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.081140+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:46:48.081140+0000","last_peered":"2024-08-17T02:46:48.081140+0000","last_clean":"2024-08-17T02:46:48.081140+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:46:48.081140+0000","last_undegraded":"2024-08-17T02:46:48.081140+0000","last_fullsized":"2024-08-17T02:46:48.081140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066868+0000","last_change":"2024-08-17T02:46:48.079170+0000","last_active":"2024-08-17T02:46:49.066868+0000","last_peered":"2024-08-17T02:46:49.066868+0000","last_clean":"2024-08-17T02:46:49.066868+0000","last_became_active":"2024-08-17T02:46:48.078398+0000","last_became_peered":"2024-08-17T02:46:48.078398+0000","last_unstale":"2024-08-17T02:46:49.066868+0000","last_undegraded":"2024-08-17T02:46:49.066868+0000","last_fullsized":"2024-08-17T02:46:49.066868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087841+0000","last_change":"2024-08-17T02:46:49.083909+0000","last_active":"2024-08-17T02:46:49.087841+0000","last_peered":"2024-08-17T02:46:49.087841+0000","last_clean":"2024-08-17T02:46:49.087841+0000","last_became_active":"2024-08-17T02:46:49.083625+0000","last_became_peered":"2024-08-17T02:46:49.083625+0000","last_unstale":"2024-08-17T02:46:49.087841+0000","last_undegraded":"2024-08-17T02:46:49.087841+0000","last_fullsized":"2024-08-17T02:46:49.087841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:36.672843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.096166+0000","last_change":"2024-08-17T02:46:48.091863+0000","last_active":"2024-08-17T02:46:48.096166+0000","last_peered":"2024-08-17T02:46:48.096166+0000","last_clean":"2024-08-17T02:46:48.096166+0000","last_became_active":"2024-08-17T02:46:48.091526+0000","last_became_peered":"2024-08-17T02:46:48.091526+0000","last_unstale":"2024-08-17T02:46:48.096166+0000","last_undegraded":"2024-08-17T02:46:48.096166+0000","last_fullsized":"2024-08-17T02:46:48.096166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:27.266794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087183+0000","last_change":"2024-08-17T02:46:49.087183+0000","last_active":"2024-08-17T02:46:49.087183+0000","last_peered":"2024-08-17T02:46:49.087183+0000","last_clean":"2024-08-17T02:46:49.087183+0000","last_became_active":"2024-08-17T02:46:49.086849+0000","last_became_peered":"2024-08-17T02:46:49.086849+0000","last_unstale":"2024-08-17T02:46:49.087183+0000","last_undegraded":"2024-08-17T02:46:49.087183+0000","last_fullsized":"2024-08-17T02:46:49.087183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071993+0000","last_change":"2024-08-17T02:46:48.084642+0000","last_active":"2024-08-17T02:46:49.071993+0000","last_peered":"2024-08-17T02:46:49.071993+0000","last_clean":"2024-08-17T02:46:49.071993+0000","last_became_active":"2024-08-17T02:46:48.084341+0000","last_became_peered":"2024-08-17T02:46:48.084341+0000","last_unstale":"2024-08-17T02:46:49.071993+0000","last_undegraded":"2024-08-17T02:46:49.071993+0000","last_fullsized":"2024-08-17T02:46:49.071993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095221+0000","last_change":"2024-08-17T02:46:49.088066+0000","last_active":"2024-08-17T02:46:49.095221+0000","last_peered":"2024-08-17T02:46:49.095221+0000","last_clean":"2024-08-17T02:46:49.095221+0000","last_became_active":"2024-08-17T02:46:49.084322+0000","last_became_peered":"2024-08-17T02:46:49.084322+0000","last_unstale":"2024-08-17T02:46:49.095221+0000","last_undegraded":"2024-08-17T02:46:49.095221+0000","last_fullsized":"2024-08-17T02:46:49.095221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068469+0000","last_change":"2024-08-17T02:46:48.081051+0000","last_active":"2024-08-17T02:46:49.068469+0000","last_peered":"2024-08-17T02:46:49.068469+0000","last_clean":"2024-08-17T02:46:49.068469+0000","last_became_active":"2024-08-17T02:46:48.080649+0000","last_became_peered":"2024-08-17T02:46:48.080649+0000","last_unstale":"2024-08-17T02:46:49.068469+0000","last_undegraded":"2024-08-17T02:46:49.068469+0000","last_fullsized":"2024-08-17T02:46:49.068469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094024+0000","last_change":"2024-08-17T02:46:49.094024+0000","last_active":"2024-08-17T02:46:49.094024+0000","last_peered":"2024-08-17T02:46:49.094024+0000","last_clean":"2024-08-17T02:46:49.094024+0000","last_became_active":"2024-08-17T02:46:49.093680+0000","last_became_peered":"2024-08-17T02:46:49.093680+0000","last_unstale":"2024-08-17T02:46:49.094024+0000","last_undegraded":"2024-08-17T02:46:49.094024+0000","last_fullsized":"2024-08-17T02:46:49.094024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:57.304010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063798+0000","last_change":"2024-08-17T02:46:48.078992+0000","last_active":"2024-08-17T02:46:49.063798+0000","last_peered":"2024-08-17T02:46:49.063798+0000","last_clean":"2024-08-17T02:46:49.063798+0000","last_became_active":"2024-08-17T02:46:48.078756+0000","last_became_peered":"2024-08-17T02:46:48.078756+0000","last_unstale":"2024-08-17T02:46:49.063798+0000","last_undegraded":"2024-08-17T02:46:49.063798+0000","last_fullsized":"2024-08-17T02:46:49.063798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:54.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095301+0000","last_change":"2024-08-17T02:46:49.088373+0000","last_active":"2024-08-17T02:46:49.095301+0000","last_peered":"2024-08-17T02:46:49.095301+0000","last_clean":"2024-08-17T02:46:49.095301+0000","last_became_active":"2024-08-17T02:46:49.087461+0000","last_became_peered":"2024-08-17T02:46:49.087461+0000","last_unstale":"2024-08-17T02:46:49.095301+0000","last_undegraded":"2024-08-17T02:46:49.095301+0000","last_fullsized":"2024-08-17T02:46:49.095301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.094135+0000","last_change":"2024-08-17T02:46:48.089957+0000","last_active":"2024-08-17T02:46:48.094135+0000","last_peered":"2024-08-17T02:46:48.094135+0000","last_clean":"2024-08-17T02:46:48.094135+0000","last_became_active":"2024-08-17T02:46:48.089649+0000","last_became_peered":"2024-08-17T02:46:48.089649+0000","last_unstale":"2024-08-17T02:46:48.094135+0000","last_undegraded":"2024-08-17T02:46:48.094135+0000","last_fullsized":"2024-08-17T02:46:48.094135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083036+0000","last_change":"2024-08-17T02:46:49.078454+0000","last_active":"2024-08-17T02:46:49.083036+0000","last_peered":"2024-08-17T02:46:49.083036+0000","last_clean":"2024-08-17T02:46:49.083036+0000","last_became_active":"2024-08-17T02:46:49.078210+0000","last_became_peered":"2024-08-17T02:46:49.078210+0000","last_unstale":"2024-08-17T02:46:49.083036+0000","last_undegraded":"2024-08-17T02:46:49.083036+0000","last_fullsized":"2024-08-17T02:46:49.083036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.064812+0000","last_change":"2024-08-17T02:46:48.077368+0000","last_active":"2024-08-17T02:46:49.064812+0000","last_peered":"2024-08-17T02:46:49.064812+0000","last_clean":"2024-08-17T02:46:49.064812+0000","last_became_active":"2024-08-17T02:46:48.077133+0000","last_became_peered":"2024-08-17T02:46:48.077133+0000","last_unstale":"2024-08-17T02:46:49.064812+0000","last_undegraded":"2024-08-17T02:46:49.064812+0000","last_fullsized":"2024-08-17T02:46:49.064812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103611+0000","last_change":"2024-08-17T02:46:49.101882+0000","last_active":"2024-08-17T02:46:49.103611+0000","last_peered":"2024-08-17T02:46:49.103611+0000","last_clean":"2024-08-17T02:46:49.103611+0000","last_became_active":"2024-08-17T02:46:49.101646+0000","last_became_peered":"2024-08-17T02:46:49.101646+0000","last_unstale":"2024-08-17T02:46:49.103611+0000","last_undegraded":"2024-08-17T02:46:49.103611+0000","last_fullsized":"2024-08-17T02:46:49.103611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103918+0000","last_change":"2024-08-17T02:46:48.081324+0000","last_active":"2024-08-17T02:46:49.103918+0000","last_peered":"2024-08-17T02:46:49.103918+0000","last_clean":"2024-08-17T02:46:49.103918+0000","last_became_active":"2024-08-17T02:46:48.078219+0000","last_became_peered":"2024-08-17T02:46:48.078219+0000","last_unstale":"2024-08-17T02:46:49.103918+0000","last_undegraded":"2024-08-17T02:46:49.103918+0000","last_fullsized":"2024-08-17T02:46:49.103918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.081991+0000","last_change":"2024-08-17T02:46:49.081991+0000","last_active":"2024-08-17T02:46:49.081991+0000","last_peered":"2024-08-17T02:46:49.081991+0000","last_clean":"2024-08-17T02:46:49.081991+0000","last_became_active":"2024-08-17T02:46:49.081605+0000","last_became_peered":"2024-08-17T02:46:49.081605+0000","last_unstale":"2024-08-17T02:46:49.081991+0000","last_undegraded":"2024-08-17T02:46:49.081991+0000","last_fullsized":"2024-08-17T02:46:49.081991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:09.169449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.091963+0000","last_change":"2024-08-17T02:46:48.087420+0000","last_active":"2024-08-17T02:46:48.091963+0000","last_peered":"2024-08-17T02:46:48.091963+0000","last_clean":"2024-08-17T02:46:48.091963+0000","last_became_active":"2024-08-17T02:46:48.087176+0000","last_became_peered":"2024-08-17T02:46:48.087176+0000","last_unstale":"2024-08-17T02:46:48.091963+0000","last_undegraded":"2024-08-17T02:46:48.091963+0000","last_fullsized":"2024-08-17T02:46:48.091963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:56.296792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079248+0000","last_change":"2024-08-17T02:46:49.079248+0000","last_active":"2024-08-17T02:46:49.079248+0000","last_peered":"2024-08-17T02:46:49.079248+0000","last_clean":"2024-08-17T02:46:49.079248+0000","last_became_active":"2024-08-17T02:46:49.078901+0000","last_became_peered":"2024-08-17T02:46:49.078901+0000","last_unstale":"2024-08-17T02:46:49.079248+0000","last_undegraded":"2024-08-17T02:46:49.079248+0000","last_fullsized":"2024-08-17T02:46:49.079248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:41.552959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063585+0000","last_change":"2024-08-17T02:46:48.087189+0000","last_active":"2024-08-17T02:46:49.063585+0000","last_peered":"2024-08-17T02:46:49.063585+0000","last_clean":"2024-08-17T02:46:49.063585+0000","last_became_active":"2024-08-17T02:46:48.086418+0000","last_became_peered":"2024-08-17T02:46:48.086418+0000","last_unstale":"2024-08-17T02:46:49.063585+0000","last_undegraded":"2024-08-17T02:46:49.063585+0000","last_fullsized":"2024-08-17T02:46:49.063585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:56.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.085453+0000","last_change":"2024-08-17T02:46:49.080433+0000","last_active":"2024-08-17T02:46:49.085453+0000","last_peered":"2024-08-17T02:46:49.085453+0000","last_clean":"2024-08-17T02:46:49.085453+0000","last_became_active":"2024-08-17T02:46:49.080054+0000","last_became_peered":"2024-08-17T02:46:49.080054+0000","last_unstale":"2024-08-17T02:46:49.085453+0000","last_undegraded":"2024-08-17T02:46:49.085453+0000","last_fullsized":"2024-08-17T02:46:49.085453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063075+0000","last_change":"2024-08-17T02:46:48.077229+0000","last_active":"2024-08-17T02:46:49.063075+0000","last_peered":"2024-08-17T02:46:49.063075+0000","last_clean":"2024-08-17T02:46:49.063075+0000","last_became_active":"2024-08-17T02:46:48.076984+0000","last_became_peered":"2024-08-17T02:46:48.076984+0000","last_unstale":"2024-08-17T02:46:49.063075+0000","last_undegraded":"2024-08-17T02:46:49.063075+0000","last_fullsized":"2024-08-17T02:46:49.063075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103538+0000","last_change":"2024-08-17T02:46:49.098807+0000","last_active":"2024-08-17T02:46:49.103538+0000","last_peered":"2024-08-17T02:46:49.103538+0000","last_clean":"2024-08-17T02:46:49.103538+0000","last_became_active":"2024-08-17T02:46:49.098544+0000","last_became_peered":"2024-08-17T02:46:49.098544+0000","last_unstale":"2024-08-17T02:46:49.103538+0000","last_undegraded":"2024-08-17T02:46:49.103538+0000","last_fullsized":"2024-08-17T02:46:49.103538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.102685+0000","last_change":"2024-08-17T02:46:48.093596+0000","last_active":"2024-08-17T02:46:49.102685+0000","last_peered":"2024-08-17T02:46:49.102685+0000","last_clean":"2024-08-17T02:46:49.102685+0000","last_became_active":"2024-08-17T02:46:48.093268+0000","last_became_peered":"2024-08-17T02:46:48.093268+0000","last_unstale":"2024-08-17T02:46:49.102685+0000","last_undegraded":"2024-08-17T02:46:49.102685+0000","last_fullsized":"2024-08-17T02:46:49.102685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082223+0000","last_change":"2024-08-17T02:46:49.082223+0000","last_active":"2024-08-17T02:46:49.082223+0000","last_peered":"2024-08-17T02:46:49.082223+0000","last_clean":"2024-08-17T02:46:49.082223+0000","last_became_active":"2024-08-17T02:46:49.081793+0000","last_became_peered":"2024-08-17T02:46:49.081793+0000","last_unstale":"2024-08-17T02:46:49.082223+0000","last_undegraded":"2024-08-17T02:46:49.082223+0000","last_fullsized":"2024-08-17T02:46:49.082223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079110+0000","last_change":"2024-08-17T02:46:49.074753+0000","last_active":"2024-08-17T02:46:49.079110+0000","last_peered":"2024-08-17T02:46:49.079110+0000","last_clean":"2024-08-17T02:46:49.079110+0000","last_became_active":"2024-08-17T02:46:49.074319+0000","last_became_peered":"2024-08-17T02:46:49.074319+0000","last_unstale":"2024-08-17T02:46:49.079110+0000","last_undegraded":"2024-08-17T02:46:49.079110+0000","last_fullsized":"2024-08-17T02:46:49.079110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103869+0000","last_change":"2024-08-17T02:46:48.091988+0000","last_active":"2024-08-17T02:46:49.103869+0000","last_peered":"2024-08-17T02:46:49.103869+0000","last_clean":"2024-08-17T02:46:49.103869+0000","last_became_active":"2024-08-17T02:46:48.091617+0000","last_became_peered":"2024-08-17T02:46:48.091617+0000","last_unstale":"2024-08-17T02:46:49.103869+0000","last_undegraded":"2024-08-17T02:46:49.103869+0000","last_fullsized":"2024-08-17T02:46:49.103869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080144+0000","last_change":"2024-08-17T02:46:49.078397+0000","last_active":"2024-08-17T02:46:49.080144+0000","last_peered":"2024-08-17T02:46:49.080144+0000","last_clean":"2024-08-17T02:46:49.080144+0000","last_became_active":"2024-08-17T02:46:49.078122+0000","last_became_peered":"2024-08-17T02:46:49.078122+0000","last_unstale":"2024-08-17T02:46:49.080144+0000","last_undegraded":"2024-08-17T02:46:49.080144+0000","last_fullsized":"2024-08-17T02:46:49.080144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104707+0000","last_change":"2024-08-17T02:46:48.092015+0000","last_active":"2024-08-17T02:46:49.104707+0000","last_peered":"2024-08-17T02:46:49.104707+0000","last_clean":"2024-08-17T02:46:49.104707+0000","last_became_active":"2024-08-17T02:46:48.091717+0000","last_became_peered":"2024-08-17T02:46:48.091717+0000","last_unstale":"2024-08-17T02:46:49.104707+0000","last_undegraded":"2024-08-17T02:46:49.104707+0000","last_fullsized":"2024-08-17T02:46:49.104707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:40.545742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.089752+0000","last_change":"2024-08-17T02:46:49.089752+0000","last_active":"2024-08-17T02:46:49.089752+0000","last_peered":"2024-08-17T02:46:49.089752+0000","last_clean":"2024-08-17T02:46:49.089752+0000","last_became_active":"2024-08-17T02:46:49.089497+0000","last_became_peered":"2024-08-17T02:46:49.089497+0000","last_unstale":"2024-08-17T02:46:49.089752+0000","last_undegraded":"2024-08-17T02:46:49.089752+0000","last_fullsized":"2024-08-17T02:46:49.089752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.098272+0000","last_change":"2024-08-17T02:46:48.082388+0000","last_active":"2024-08-17T02:46:49.098272+0000","last_peered":"2024-08-17T02:46:49.098272+0000","last_clean":"2024-08-17T02:46:49.098272+0000","last_became_active":"2024-08-17T02:46:48.082137+0000","last_became_peered":"2024-08-17T02:46:48.082137+0000","last_unstale":"2024-08-17T02:46:49.098272+0000","last_undegraded":"2024-08-17T02:46:49.098272+0000","last_fullsized":"2024-08-17T02:46:49.098272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100362+0000","last_change":"2024-08-17T02:46:49.091589+0000","last_active":"2024-08-17T02:46:49.100362+0000","last_peered":"2024-08-17T02:46:49.100362+0000","last_clean":"2024-08-17T02:46:49.100362+0000","last_became_active":"2024-08-17T02:46:49.091354+0000","last_became_peered":"2024-08-17T02:46:49.091354+0000","last_unstale":"2024-08-17T02:46:49.100362+0000","last_undegraded":"2024-08-17T02:46:49.100362+0000","last_fullsized":"2024-08-17T02:46:49.100362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103909+0000","last_change":"2024-08-17T02:46:48.081234+0000","last_active":"2024-08-17T02:46:49.103909+0000","last_peered":"2024-08-17T02:46:49.103909+0000","last_clean":"2024-08-17T02:46:49.103909+0000","last_became_active":"2024-08-17T02:46:48.081039+0000","last_became_peered":"2024-08-17T02:46:48.081039+0000","last_unstale":"2024-08-17T02:46:49.103909+0000","last_undegraded":"2024-08-17T02:46:49.103909+0000","last_fullsized":"2024-08-17T02:46:49.103909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":806912,"data_stored":661138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":76578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":70326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":76488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1390000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1789999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":815104,"data_stored":661194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:53.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.406+0000 7fdefbe00640 1 Processor -- start 2024-08-17T02:46:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.406+0000 7fdefbe00640 1 -- start start 2024-08-17T02:46:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdefbe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 0x7fdef40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdefbe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef40afc10 con 0x7fdef4155180 2024-08-17T02:46:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdefbe00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef40af000 con 0x7fdef4155550 2024-08-17T02:46:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdefbe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40af2e0 con 0x7fdef406e790 2024-08-17T02:46:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdef9400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdef4155180 0x7fdef40ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35540/0 (socket says 172.21.15.149:35540) 2024-08-17T02:46:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdef9400640 1 -- 172.21.15.149:0/91418648 learned_addr learned my addr 172.21.15.149:0/91418648 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326833740 0 0) 0x7fdef40afc10 con 0x7fdef4155180 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdef9e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 0x7fdef40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.408+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdedc0045f0 con 0x7fdef4155180 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3896173882 0 0) 0x7fdedc0045f0 con 0x7fdef4155180 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 msgr2=0x7fdef40aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 0x7fdef40aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 >> v1:172.21.15.161:6789/0 conn(0x7fdef4155550 legacy=0x7fdef406e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40af5c0 con 0x7fdef4155180 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7fdee8001470 con 0x7fdef4155180 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 >> v1:172.21.15.149:6789/0 conn(0x7fdef4155180 legacy=0x7fdef40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdedc004b10 0x7fdedc004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 0x7fdedc005890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdedc006240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40af2e0 con 0x7fdedc005dd0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc00cb90 con 0x7fdedc004b10 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc00cd50 con 0x7fdef406e790 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdedc006240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef8a00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 0x7fdedc005890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9400640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdedc004b10 0x7fdedc004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9e00640 1 -- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 msgr2=0x7fdedc005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef406e790 0x7fdedc005890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9e00640 1 -- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdedc004b10 msgr2=0x7fdedc004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdedc004b10 0x7fdedc004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9e00640 1 -- 172.21.15.149:0/91418648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0045f0 con 0x7fdedc005dd0 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.409+0000 7fdef9400640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdedc004b10 0x7fdedc004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.410+0000 7fdef9e00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdedc006240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00e210 tx=0x7fdeec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e0ad23218ca4d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec02c040 con 0x7fdedc005dd0 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec00f040 con 0x7fdedc005dd0 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdef3e00640 1 -- 172.21.15.149:0/91418648 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec030630 con 0x7fdedc005dd0 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdefbe00640 1 -- 172.21.15.149:0/91418648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 msgr2=0x7fdedc006240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdefbe00640 1 --2- 172.21.15.149:0/91418648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdedc006240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00e210 tx=0x7fdeec00b040 comp rx=0 tx=0).stop 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdef9e00640 1 -- 172.21.15.149:0/91418648 reap_dead start 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdefbe00640 1 -- 172.21.15.149:0/91418648 shutdown_connections 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdefbe00640 1 -- 172.21.15.149:0/91418648 >> 172.21.15.149:0/91418648 conn(0x7fdef40cb9b0 msgr2=0x7fdef40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdefbe00640 1 -- 172.21.15.149:0/91418648 shutdown_connections 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.411+0000 7fdefbe00640 1 -- 172.21.15.149:0/91418648 wait complete. 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.412+0000 7fdefbe00640 1 Processor -- start 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.413+0000 7fdefbe00640 1 -- start start 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.413+0000 7fdefbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdef4151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.413+0000 7fdefbe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef40c1b70 0x7fdef416a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.413+0000 7fdefbe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef4153290 0x7fdef4153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdefbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4151bd0 con 0x7fdedc005dd0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdefbe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4153c40 con 0x7fdef40c1b70 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdefbe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4157ac0 con 0x7fdef4153290 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdef4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdef4151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47980/0 (socket says 172.21.15.149:47980) 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 -- 172.21.15.149:0/903276961 learned_addr learned my addr 172.21.15.149:0/903276961 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9e00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef4153290 0x7fdef4153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef8a00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef40c1b70 0x7fdef416a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 -- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef4153290 msgr2=0x7fdef4153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef4153290 0x7fdef4153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 -- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef40c1b70 msgr2=0x7fdef416a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef40c1b70 0x7fdef416a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 -- 172.21.15.149:0/903276961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4156c10 con 0x7fdedc005dd0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.414+0000 7fdef9400640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdef4151690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e980 tx=0x7fdee80014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.415+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800c8d0 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.415+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee800ca30 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.415+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800cdd0 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.415+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef4156eb0 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.415+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef4157470 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.416+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef4064db0 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.417+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdee8013630 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.417+0000 7fdef0c00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fded4065180 0x7fded4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.418+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdee8082360 con 0x7fdedc005dd0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.418+0000 7fdef8a00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fded4065180 0x7fded4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.418+0000 7fdef8a00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fded4065180 0x7fded4067630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdef4154f20 tx=0x7fdee0007c80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.422+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdee80504d0 con 0x7fdedc005dd0 2024-08-17T02:46:53.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.594+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdef4157c00 con 0x7fded4065180 2024-08-17T02:46:53.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.601+0000 7fdef0c00640 1 -- 172.21.15.149:0/903276961 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264705 (secure 0 0 0) 0x7fdee0003d50 con 0x7fded4065180 2024-08-17T02:46:53.608 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:53.610 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fded4065180 msgr2=0x7fded4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fded4065180 0x7fded4067630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdef4154f20 tx=0x7fdee0007c80 comp rx=0 tx=0).stop 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 msgr2=0x7fdef4151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdef4151690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e980 tx=0x7fdee80014f0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 shutdown_connections 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fded4065180 0x7fded4067630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef4153290 0x7fdef4153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef40c1b70 0x7fdef416a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 --2- 172.21.15.149:0/903276961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdedc005dd0 0x7fdef4151690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 >> 172.21.15.149:0/903276961 conn(0x7fdef40cb9b0 msgr2=0x7fdef40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.605+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 shutdown_connections 2024-08-17T02:46:53.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.606+0000 7fdefbe00640 1 -- 172.21.15.149:0/903276961 wait complete. 2024-08-17T02:46:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:46:51.625498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381764,"kb_used_data":2892,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592956,"statfs":{"total":773094113280,"available":770655186944,"internally_reserved":0,"allocated":2961408,"data_stored":1765876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572859"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087269+0000","last_change":"2024-08-17T02:46:49.087269+0000","last_active":"2024-08-17T02:46:49.087269+0000","last_peered":"2024-08-17T02:46:49.087269+0000","last_clean":"2024-08-17T02:46:49.087269+0000","last_became_active":"2024-08-17T02:46:49.086977+0000","last_became_peered":"2024-08-17T02:46:49.086977+0000","last_unstale":"2024-08-17T02:46:49.087269+0000","last_undegraded":"2024-08-17T02:46:49.087269+0000","last_fullsized":"2024-08-17T02:46:49.087269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095362+0000","last_change":"2024-08-17T02:46:49.092074+0000","last_active":"2024-08-17T02:46:49.095362+0000","last_peered":"2024-08-17T02:46:49.095362+0000","last_clean":"2024-08-17T02:46:49.095362+0000","last_became_active":"2024-08-17T02:46:49.090161+0000","last_became_peered":"2024-08-17T02:46:49.090161+0000","last_unstale":"2024-08-17T02:46:49.095362+0000","last_undegraded":"2024-08-17T02:46:49.095362+0000","last_fullsized":"2024-08-17T02:46:49.095362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086579+0000","last_change":"2024-08-17T02:46:49.086579+0000","last_active":"2024-08-17T02:46:49.086579+0000","last_peered":"2024-08-17T02:46:49.086579+0000","last_clean":"2024-08-17T02:46:49.086579+0000","last_became_active":"2024-08-17T02:46:49.084975+0000","last_became_peered":"2024-08-17T02:46:49.084975+0000","last_unstale":"2024-08-17T02:46:49.086579+0000","last_undegraded":"2024-08-17T02:46:49.086579+0000","last_fullsized":"2024-08-17T02:46:49.086579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096542+0000","last_change":"2024-08-17T02:46:49.094697+0000","last_active":"2024-08-17T02:46:49.096542+0000","last_peered":"2024-08-17T02:46:49.096542+0000","last_clean":"2024-08-17T02:46:49.096542+0000","last_became_active":"2024-08-17T02:46:49.093541+0000","last_became_peered":"2024-08-17T02:46:49.093541+0000","last_unstale":"2024-08-17T02:46:49.096542+0000","last_undegraded":"2024-08-17T02:46:49.096542+0000","last_fullsized":"2024-08-17T02:46:49.096542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082685+0000","last_change":"2024-08-17T02:46:49.082685+0000","last_active":"2024-08-17T02:46:49.082685+0000","last_peered":"2024-08-17T02:46:49.082685+0000","last_clean":"2024-08-17T02:46:49.082685+0000","last_became_active":"2024-08-17T02:46:49.082382+0000","last_became_peered":"2024-08-17T02:46:49.082382+0000","last_unstale":"2024-08-17T02:46:49.082685+0000","last_undegraded":"2024-08-17T02:46:49.082685+0000","last_fullsized":"2024-08-17T02:46:49.082685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097478+0000","last_change":"2024-08-17T02:46:49.096292+0000","last_active":"2024-08-17T02:46:49.097478+0000","last_peered":"2024-08-17T02:46:49.097478+0000","last_clean":"2024-08-17T02:46:49.097478+0000","last_became_active":"2024-08-17T02:46:49.096030+0000","last_became_peered":"2024-08-17T02:46:49.096030+0000","last_unstale":"2024-08-17T02:46:49.097478+0000","last_undegraded":"2024-08-17T02:46:49.097478+0000","last_fullsized":"2024-08-17T02:46:49.097478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096389+0000","last_change":"2024-08-17T02:46:49.096389+0000","last_active":"2024-08-17T02:46:49.096389+0000","last_peered":"2024-08-17T02:46:49.096389+0000","last_clean":"2024-08-17T02:46:49.096389+0000","last_became_active":"2024-08-17T02:46:49.095461+0000","last_became_peered":"2024-08-17T02:46:49.095461+0000","last_unstale":"2024-08-17T02:46:49.096389+0000","last_undegraded":"2024-08-17T02:46:49.096389+0000","last_fullsized":"2024-08-17T02:46:49.096389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087502+0000","last_change":"2024-08-17T02:46:49.080927+0000","last_active":"2024-08-17T02:46:49.087502+0000","last_peered":"2024-08-17T02:46:49.087502+0000","last_clean":"2024-08-17T02:46:49.087502+0000","last_became_active":"2024-08-17T02:46:49.080697+0000","last_became_peered":"2024-08-17T02:46:49.080697+0000","last_unstale":"2024-08-17T02:46:49.087502+0000","last_undegraded":"2024-08-17T02:46:49.087502+0000","last_fullsized":"2024-08-17T02:46:49.087502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:02.889606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.101464+0000","last_change":"2024-08-17T02:46:49.101464+0000","last_active":"2024-08-17T02:46:49.101464+0000","last_peered":"2024-08-17T02:46:49.101464+0000","last_clean":"2024-08-17T02:46:49.101464+0000","last_became_active":"2024-08-17T02:46:49.100349+0000","last_became_peered":"2024-08-17T02:46:49.100349+0000","last_unstale":"2024-08-17T02:46:49.101464+0000","last_undegraded":"2024-08-17T02:46:49.101464+0000","last_fullsized":"2024-08-17T02:46:49.101464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104176+0000","last_change":"2024-08-17T02:46:49.104176+0000","last_active":"2024-08-17T02:46:49.104176+0000","last_peered":"2024-08-17T02:46:49.104176+0000","last_clean":"2024-08-17T02:46:49.104176+0000","last_became_active":"2024-08-17T02:46:49.095015+0000","last_became_peered":"2024-08-17T02:46:49.095015+0000","last_unstale":"2024-08-17T02:46:49.104176+0000","last_undegraded":"2024-08-17T02:46:49.104176+0000","last_fullsized":"2024-08-17T02:46:49.104176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082956+0000","last_change":"2024-08-17T02:46:49.082956+0000","last_active":"2024-08-17T02:46:49.082956+0000","last_peered":"2024-08-17T02:46:49.082956+0000","last_clean":"2024-08-17T02:46:49.082956+0000","last_became_active":"2024-08-17T02:46:49.080315+0000","last_became_peered":"2024-08-17T02:46:49.080315+0000","last_unstale":"2024-08-17T02:46:49.082956+0000","last_undegraded":"2024-08-17T02:46:49.082956+0000","last_fullsized":"2024-08-17T02:46:49.082956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.106327+0000","last_change":"2024-08-17T02:46:49.106327+0000","last_active":"2024-08-17T02:46:49.106327+0000","last_peered":"2024-08-17T02:46:49.106327+0000","last_clean":"2024-08-17T02:46:49.106327+0000","last_became_active":"2024-08-17T02:46:49.105995+0000","last_became_peered":"2024-08-17T02:46:49.105995+0000","last_unstale":"2024-08-17T02:46:49.106327+0000","last_undegraded":"2024-08-17T02:46:49.106327+0000","last_fullsized":"2024-08-17T02:46:49.106327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:20.150470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100233+0000","last_change":"2024-08-17T02:46:49.088848+0000","last_active":"2024-08-17T02:46:49.100233+0000","last_peered":"2024-08-17T02:46:49.100233+0000","last_clean":"2024-08-17T02:46:49.100233+0000","last_became_active":"2024-08-17T02:46:49.088404+0000","last_became_peered":"2024-08-17T02:46:49.088404+0000","last_unstale":"2024-08-17T02:46:49.100233+0000","last_undegraded":"2024-08-17T02:46:49.100233+0000","last_fullsized":"2024-08-17T02:46:49.100233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.074941+0000","last_change":"2024-08-17T02:46:49.074941+0000","last_active":"2024-08-17T02:46:49.074941+0000","last_peered":"2024-08-17T02:46:49.074941+0000","last_clean":"2024-08-17T02:46:49.074941+0000","last_became_active":"2024-08-17T02:46:49.074163+0000","last_became_peered":"2024-08-17T02:46:49.074163+0000","last_unstale":"2024-08-17T02:46:49.074941+0000","last_undegraded":"2024-08-17T02:46:49.074941+0000","last_fullsized":"2024-08-17T02:46:49.074941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086626+0000","last_change":"2024-08-17T02:46:49.081496+0000","last_active":"2024-08-17T02:46:49.086626+0000","last_peered":"2024-08-17T02:46:49.086626+0000","last_clean":"2024-08-17T02:46:49.086626+0000","last_became_active":"2024-08-17T02:46:49.081271+0000","last_became_peered":"2024-08-17T02:46:49.081271+0000","last_unstale":"2024-08-17T02:46:49.086626+0000","last_undegraded":"2024-08-17T02:46:49.086626+0000","last_fullsized":"2024-08-17T02:46:49.086626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079182+0000","last_change":"2024-08-17T02:46:49.075960+0000","last_active":"2024-08-17T02:46:49.079182+0000","last_peered":"2024-08-17T02:46:49.079182+0000","last_clean":"2024-08-17T02:46:49.079182+0000","last_became_active":"2024-08-17T02:46:49.075702+0000","last_became_peered":"2024-08-17T02:46:49.075702+0000","last_unstale":"2024-08-17T02:46:49.079182+0000","last_undegraded":"2024-08-17T02:46:49.079182+0000","last_fullsized":"2024-08-17T02:46:49.079182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093082+0000","last_change":"2024-08-17T02:46:49.090727+0000","last_active":"2024-08-17T02:46:49.093082+0000","last_peered":"2024-08-17T02:46:49.093082+0000","last_clean":"2024-08-17T02:46:49.093082+0000","last_became_active":"2024-08-17T02:46:49.090098+0000","last_became_peered":"2024-08-17T02:46:49.090098+0000","last_unstale":"2024-08-17T02:46:49.093082+0000","last_undegraded":"2024-08-17T02:46:49.093082+0000","last_fullsized":"2024-08-17T02:46:49.093082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092750+0000","last_change":"2024-08-17T02:46:49.090463+0000","last_active":"2024-08-17T02:46:49.092750+0000","last_peered":"2024-08-17T02:46:49.092750+0000","last_clean":"2024-08-17T02:46:49.092750+0000","last_became_active":"2024-08-17T02:46:49.090190+0000","last_became_peered":"2024-08-17T02:46:49.090190+0000","last_unstale":"2024-08-17T02:46:49.092750+0000","last_undegraded":"2024-08-17T02:46:49.092750+0000","last_fullsized":"2024-08-17T02:46:49.092750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:29.020704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.090958+0000","last_change":"2024-08-17T02:46:49.090958+0000","last_active":"2024-08-17T02:46:49.090958+0000","last_peered":"2024-08-17T02:46:49.090958+0000","last_clean":"2024-08-17T02:46:49.090958+0000","last_became_active":"2024-08-17T02:46:49.089995+0000","last_became_peered":"2024-08-17T02:46:49.089995+0000","last_unstale":"2024-08-17T02:46:49.090958+0000","last_undegraded":"2024-08-17T02:46:49.090958+0000","last_fullsized":"2024-08-17T02:46:49.090958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087791+0000","last_change":"2024-08-17T02:46:49.087791+0000","last_active":"2024-08-17T02:46:49.087791+0000","last_peered":"2024-08-17T02:46:49.087791+0000","last_clean":"2024-08-17T02:46:49.087791+0000","last_became_active":"2024-08-17T02:46:49.087472+0000","last_became_peered":"2024-08-17T02:46:49.087472+0000","last_unstale":"2024-08-17T02:46:49.087791+0000","last_undegraded":"2024-08-17T02:46:49.087791+0000","last_fullsized":"2024-08-17T02:46:49.087791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094327+0000","last_change":"2024-08-17T02:46:49.094327+0000","last_active":"2024-08-17T02:46:49.094327+0000","last_peered":"2024-08-17T02:46:49.094327+0000","last_clean":"2024-08-17T02:46:49.094327+0000","last_became_active":"2024-08-17T02:46:49.087534+0000","last_became_peered":"2024-08-17T02:46:49.087534+0000","last_unstale":"2024-08-17T02:46:49.094327+0000","last_undegraded":"2024-08-17T02:46:49.094327+0000","last_fullsized":"2024-08-17T02:46:49.094327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092779+0000","last_change":"2024-08-17T02:46:49.086507+0000","last_active":"2024-08-17T02:46:49.092779+0000","last_peered":"2024-08-17T02:46:49.092779+0000","last_clean":"2024-08-17T02:46:49.092779+0000","last_became_active":"2024-08-17T02:46:49.086187+0000","last_became_peered":"2024-08-17T02:46:49.086187+0000","last_unstale":"2024-08-17T02:46:49.092779+0000","last_undegraded":"2024-08-17T02:46:49.092779+0000","last_fullsized":"2024-08-17T02:46:49.092779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093374+0000","last_change":"2024-08-17T02:46:49.087201+0000","last_active":"2024-08-17T02:46:49.093374+0000","last_peered":"2024-08-17T02:46:49.093374+0000","last_clean":"2024-08-17T02:46:49.093374+0000","last_became_active":"2024-08-17T02:46:49.086903+0000","last_became_peered":"2024-08-17T02:46:49.086903+0000","last_unstale":"2024-08-17T02:46:49.093374+0000","last_undegraded":"2024-08-17T02:46:49.093374+0000","last_fullsized":"2024-08-17T02:46:49.093374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:13.388708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093050+0000","last_change":"2024-08-17T02:46:49.084845+0000","last_active":"2024-08-17T02:46:49.093050+0000","last_peered":"2024-08-17T02:46:49.093050+0000","last_clean":"2024-08-17T02:46:49.093050+0000","last_became_active":"2024-08-17T02:46:49.084208+0000","last_became_peered":"2024-08-17T02:46:49.084208+0000","last_unstale":"2024-08-17T02:46:49.093050+0000","last_undegraded":"2024-08-17T02:46:49.093050+0000","last_fullsized":"2024-08-17T02:46:49.093050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100172+0000","last_change":"2024-08-17T02:46:49.088034+0000","last_active":"2024-08-17T02:46:49.100172+0000","last_peered":"2024-08-17T02:46:49.100172+0000","last_clean":"2024-08-17T02:46:49.100172+0000","last_became_active":"2024-08-17T02:46:49.085634+0000","last_became_peered":"2024-08-17T02:46:49.085634+0000","last_unstale":"2024-08-17T02:46:49.100172+0000","last_undegraded":"2024-08-17T02:46:49.100172+0000","last_fullsized":"2024-08-17T02:46:49.100172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:13.489732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093914+0000","last_change":"2024-08-17T02:46:49.093914+0000","last_active":"2024-08-17T02:46:49.093914+0000","last_peered":"2024-08-17T02:46:49.093914+0000","last_clean":"2024-08-17T02:46:49.093914+0000","last_became_active":"2024-08-17T02:46:49.093612+0000","last_became_peered":"2024-08-17T02:46:49.093612+0000","last_unstale":"2024-08-17T02:46:49.093914+0000","last_undegraded":"2024-08-17T02:46:49.093914+0000","last_fullsized":"2024-08-17T02:46:49.093914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094706+0000","last_change":"2024-08-17T02:46:49.091029+0000","last_active":"2024-08-17T02:46:49.094706+0000","last_peered":"2024-08-17T02:46:49.094706+0000","last_clean":"2024-08-17T02:46:49.094706+0000","last_became_active":"2024-08-17T02:46:49.090798+0000","last_became_peered":"2024-08-17T02:46:49.090798+0000","last_unstale":"2024-08-17T02:46:49.094706+0000","last_undegraded":"2024-08-17T02:46:49.094706+0000","last_fullsized":"2024-08-17T02:46:49.094706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103306+0000","last_change":"2024-08-17T02:46:49.097976+0000","last_active":"2024-08-17T02:46:49.103306+0000","last_peered":"2024-08-17T02:46:49.103306+0000","last_clean":"2024-08-17T02:46:49.103306+0000","last_became_active":"2024-08-17T02:46:49.095177+0000","last_became_peered":"2024-08-17T02:46:49.095177+0000","last_unstale":"2024-08-17T02:46:49.103306+0000","last_undegraded":"2024-08-17T02:46:49.103306+0000","last_fullsized":"2024-08-17T02:46:49.103306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.269002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094891+0000","last_change":"2024-08-17T02:46:49.094891+0000","last_active":"2024-08-17T02:46:49.094891+0000","last_peered":"2024-08-17T02:46:49.094891+0000","last_clean":"2024-08-17T02:46:49.094891+0000","last_became_active":"2024-08-17T02:46:49.094626+0000","last_became_peered":"2024-08-17T02:46:49.094626+0000","last_unstale":"2024-08-17T02:46:49.094891+0000","last_undegraded":"2024-08-17T02:46:49.094891+0000","last_fullsized":"2024-08-17T02:46:49.094891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092753+0000","last_change":"2024-08-17T02:46:49.085872+0000","last_active":"2024-08-17T02:46:49.092753+0000","last_peered":"2024-08-17T02:46:49.092753+0000","last_clean":"2024-08-17T02:46:49.092753+0000","last_became_active":"2024-08-17T02:46:49.085620+0000","last_became_peered":"2024-08-17T02:46:49.085620+0000","last_unstale":"2024-08-17T02:46:49.092753+0000","last_undegraded":"2024-08-17T02:46:49.092753+0000","last_fullsized":"2024-08-17T02:46:49.092753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087104+0000","last_change":"2024-08-17T02:46:49.079133+0000","last_active":"2024-08-17T02:46:49.087104+0000","last_peered":"2024-08-17T02:46:49.087104+0000","last_clean":"2024-08-17T02:46:49.087104+0000","last_became_active":"2024-08-17T02:46:49.078405+0000","last_became_peered":"2024-08-17T02:46:49.078405+0000","last_unstale":"2024-08-17T02:46:49.087104+0000","last_undegraded":"2024-08-17T02:46:49.087104+0000","last_fullsized":"2024-08-17T02:46:49.087104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:57.922654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105591+0000","last_change":"2024-08-17T02:46:49.105591+0000","last_active":"2024-08-17T02:46:49.105591+0000","last_peered":"2024-08-17T02:46:49.105591+0000","last_clean":"2024-08-17T02:46:49.105591+0000","last_became_active":"2024-08-17T02:46:49.104220+0000","last_became_peered":"2024-08-17T02:46:49.104220+0000","last_unstale":"2024-08-17T02:46:49.105591+0000","last_undegraded":"2024-08-17T02:46:49.105591+0000","last_fullsized":"2024-08-17T02:46:49.105591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.072690+0000","last_change":"2024-08-17T02:46:49.072690+0000","last_active":"2024-08-17T02:46:49.072690+0000","last_peered":"2024-08-17T02:46:49.072690+0000","last_clean":"2024-08-17T02:46:49.072690+0000","last_became_active":"2024-08-17T02:46:49.072424+0000","last_became_peered":"2024-08-17T02:46:49.072424+0000","last_unstale":"2024-08-17T02:46:49.072690+0000","last_undegraded":"2024-08-17T02:46:49.072690+0000","last_fullsized":"2024-08-17T02:46:49.072690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:35.318940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099753+0000","last_change":"2024-08-17T02:46:48.085210+0000","last_active":"2024-08-17T02:46:49.099753+0000","last_peered":"2024-08-17T02:46:49.099753+0000","last_clean":"2024-08-17T02:46:49.099753+0000","last_became_active":"2024-08-17T02:46:48.084916+0000","last_became_peered":"2024-08-17T02:46:48.084916+0000","last_unstale":"2024-08-17T02:46:49.099753+0000","last_undegraded":"2024-08-17T02:46:49.099753+0000","last_fullsized":"2024-08-17T02:46:49.099753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080439+0000","last_change":"2024-08-17T02:46:49.080439+0000","last_active":"2024-08-17T02:46:49.080439+0000","last_peered":"2024-08-17T02:46:49.080439+0000","last_clean":"2024-08-17T02:46:49.080439+0000","last_became_active":"2024-08-17T02:46:49.080211+0000","last_became_peered":"2024-08-17T02:46:49.080211+0000","last_unstale":"2024-08-17T02:46:49.080439+0000","last_undegraded":"2024-08-17T02:46:49.080439+0000","last_fullsized":"2024-08-17T02:46:49.080439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.072519+0000","last_change":"2024-08-17T02:46:48.090901+0000","last_active":"2024-08-17T02:46:49.072519+0000","last_peered":"2024-08-17T02:46:49.072519+0000","last_clean":"2024-08-17T02:46:49.072519+0000","last_became_active":"2024-08-17T02:46:48.089868+0000","last_became_peered":"2024-08-17T02:46:48.089868+0000","last_unstale":"2024-08-17T02:46:49.072519+0000","last_undegraded":"2024-08-17T02:46:49.072519+0000","last_fullsized":"2024-08-17T02:46:49.072519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079910+0000","last_change":"2024-08-17T02:46:48.076568+0000","last_active":"2024-08-17T02:46:49.079910+0000","last_peered":"2024-08-17T02:46:49.079910+0000","last_clean":"2024-08-17T02:46:49.079910+0000","last_became_active":"2024-08-17T02:46:48.076238+0000","last_became_peered":"2024-08-17T02:46:48.076238+0000","last_unstale":"2024-08-17T02:46:49.079910+0000","last_undegraded":"2024-08-17T02:46:49.079910+0000","last_fullsized":"2024-08-17T02:46:49.079910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103277+0000","last_change":"2024-08-17T02:46:49.095963+0000","last_active":"2024-08-17T02:46:49.103277+0000","last_peered":"2024-08-17T02:46:49.103277+0000","last_clean":"2024-08-17T02:46:49.103277+0000","last_became_active":"2024-08-17T02:46:49.095697+0000","last_became_peered":"2024-08-17T02:46:49.095697+0000","last_unstale":"2024-08-17T02:46:49.103277+0000","last_undegraded":"2024-08-17T02:46:49.103277+0000","last_fullsized":"2024-08-17T02:46:49.103277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066816+0000","last_change":"2024-08-17T02:46:48.090123+0000","last_active":"2024-08-17T02:46:49.066816+0000","last_peered":"2024-08-17T02:46:49.066816+0000","last_clean":"2024-08-17T02:46:49.066816+0000","last_became_active":"2024-08-17T02:46:48.089137+0000","last_became_peered":"2024-08-17T02:46:48.089137+0000","last_unstale":"2024-08-17T02:46:49.066816+0000","last_undegraded":"2024-08-17T02:46:49.066816+0000","last_fullsized":"2024-08-17T02:46:49.066816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094584+0000","last_change":"2024-08-17T02:46:49.086912+0000","last_active":"2024-08-17T02:46:49.094584+0000","last_peered":"2024-08-17T02:46:49.094584+0000","last_clean":"2024-08-17T02:46:49.094584+0000","last_became_active":"2024-08-17T02:46:49.086607+0000","last_became_peered":"2024-08-17T02:46:49.086607+0000","last_unstale":"2024-08-17T02:46:49.094584+0000","last_undegraded":"2024-08-17T02:46:49.094584+0000","last_fullsized":"2024-08-17T02:46:49.094584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.084276+0000","last_change":"2024-08-17T02:46:48.082227+0000","last_active":"2024-08-17T02:46:48.084276+0000","last_peered":"2024-08-17T02:46:48.084276+0000","last_clean":"2024-08-17T02:46:48.084276+0000","last_became_active":"2024-08-17T02:46:48.081670+0000","last_became_peered":"2024-08-17T02:46:48.081670+0000","last_unstale":"2024-08-17T02:46:48.084276+0000","last_undegraded":"2024-08-17T02:46:48.084276+0000","last_fullsized":"2024-08-17T02:46:48.084276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093016+0000","last_change":"2024-08-17T02:46:49.089798+0000","last_active":"2024-08-17T02:46:49.093016+0000","last_peered":"2024-08-17T02:46:49.093016+0000","last_clean":"2024-08-17T02:46:49.093016+0000","last_became_active":"2024-08-17T02:46:49.088859+0000","last_became_peered":"2024-08-17T02:46:49.088859+0000","last_unstale":"2024-08-17T02:46:49.093016+0000","last_undegraded":"2024-08-17T02:46:49.093016+0000","last_fullsized":"2024-08-17T02:46:49.093016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.067403+0000","last_change":"2024-08-17T02:46:48.075698+0000","last_active":"2024-08-17T02:46:49.067403+0000","last_peered":"2024-08-17T02:46:49.067403+0000","last_clean":"2024-08-17T02:46:49.067403+0000","last_became_active":"2024-08-17T02:46:48.075409+0000","last_became_peered":"2024-08-17T02:46:48.075409+0000","last_unstale":"2024-08-17T02:46:49.067403+0000","last_undegraded":"2024-08-17T02:46:49.067403+0000","last_fullsized":"2024-08-17T02:46:49.067403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.090547+0000","last_change":"2024-08-17T02:46:49.090547+0000","last_active":"2024-08-17T02:46:49.090547+0000","last_peered":"2024-08-17T02:46:49.090547+0000","last_clean":"2024-08-17T02:46:49.090547+0000","last_became_active":"2024-08-17T02:46:49.090316+0000","last_became_peered":"2024-08-17T02:46:49.090316+0000","last_unstale":"2024-08-17T02:46:49.090547+0000","last_undegraded":"2024-08-17T02:46:49.090547+0000","last_fullsized":"2024-08-17T02:46:49.090547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097432+0000","last_change":"2024-08-17T02:46:48.079760+0000","last_active":"2024-08-17T02:46:49.097432+0000","last_peered":"2024-08-17T02:46:49.097432+0000","last_clean":"2024-08-17T02:46:49.097432+0000","last_became_active":"2024-08-17T02:46:48.079517+0000","last_became_peered":"2024-08-17T02:46:48.079517+0000","last_unstale":"2024-08-17T02:46:49.097432+0000","last_undegraded":"2024-08-17T02:46:49.097432+0000","last_fullsized":"2024-08-17T02:46:49.097432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:10:17.014457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.091777+0000","last_change":"2024-08-17T02:46:49.091777+0000","last_active":"2024-08-17T02:46:49.091777+0000","last_peered":"2024-08-17T02:46:49.091777+0000","last_clean":"2024-08-17T02:46:49.091777+0000","last_became_active":"2024-08-17T02:46:49.085179+0000","last_became_peered":"2024-08-17T02:46:49.085179+0000","last_unstale":"2024-08-17T02:46:49.091777+0000","last_undegraded":"2024-08-17T02:46:49.091777+0000","last_fullsized":"2024-08-17T02:46:49.091777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:28.274012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.111677+0000","last_change":"2024-08-17T02:46:48.080838+0000","last_active":"2024-08-17T02:46:49.111677+0000","last_peered":"2024-08-17T02:46:49.111677+0000","last_clean":"2024-08-17T02:46:49.111677+0000","last_became_active":"2024-08-17T02:46:48.080291+0000","last_became_peered":"2024-08-17T02:46:48.080291+0000","last_unstale":"2024-08-17T02:46:49.111677+0000","last_undegraded":"2024-08-17T02:46:49.111677+0000","last_fullsized":"2024-08-17T02:46:49.111677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.088724+0000","last_change":"2024-08-17T02:46:49.088724+0000","last_active":"2024-08-17T02:46:49.088724+0000","last_peered":"2024-08-17T02:46:49.088724+0000","last_clean":"2024-08-17T02:46:49.088724+0000","last_became_active":"2024-08-17T02:46:49.088123+0000","last_became_peered":"2024-08-17T02:46:49.088123+0000","last_unstale":"2024-08-17T02:46:49.088724+0000","last_undegraded":"2024-08-17T02:46:49.088724+0000","last_fullsized":"2024-08-17T02:46:49.088724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.102289+0000","last_change":"2024-08-17T02:46:48.091037+0000","last_active":"2024-08-17T02:46:49.102289+0000","last_peered":"2024-08-17T02:46:49.102289+0000","last_clean":"2024-08-17T02:46:49.102289+0000","last_became_active":"2024-08-17T02:46:48.090779+0000","last_became_peered":"2024-08-17T02:46:48.090779+0000","last_unstale":"2024-08-17T02:46:49.102289+0000","last_undegraded":"2024-08-17T02:46:49.102289+0000","last_fullsized":"2024-08-17T02:46:49.102289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.089937+0000","last_change":"2024-08-17T02:46:49.089937+0000","last_active":"2024-08-17T02:46:49.089937+0000","last_peered":"2024-08-17T02:46:49.089937+0000","last_clean":"2024-08-17T02:46:49.089937+0000","last_became_active":"2024-08-17T02:46:49.089635+0000","last_became_peered":"2024-08-17T02:46:49.089635+0000","last_unstale":"2024-08-17T02:46:49.089937+0000","last_undegraded":"2024-08-17T02:46:49.089937+0000","last_fullsized":"2024-08-17T02:46:49.089937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068360+0000","last_change":"2024-08-17T02:46:48.078674+0000","last_active":"2024-08-17T02:46:49.068360+0000","last_peered":"2024-08-17T02:46:49.068360+0000","last_clean":"2024-08-17T02:46:49.068360+0000","last_became_active":"2024-08-17T02:46:48.078254+0000","last_became_peered":"2024-08-17T02:46:48.078254+0000","last_unstale":"2024-08-17T02:46:49.068360+0000","last_undegraded":"2024-08-17T02:46:49.068360+0000","last_fullsized":"2024-08-17T02:46:49.068360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083382+0000","last_change":"2024-08-17T02:46:49.083382+0000","last_active":"2024-08-17T02:46:49.083382+0000","last_peered":"2024-08-17T02:46:49.083382+0000","last_clean":"2024-08-17T02:46:49.083382+0000","last_became_active":"2024-08-17T02:46:49.083117+0000","last_became_peered":"2024-08-17T02:46:49.083117+0000","last_unstale":"2024-08-17T02:46:49.083382+0000","last_undegraded":"2024-08-17T02:46:49.083382+0000","last_fullsized":"2024-08-17T02:46:49.083382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.092769+0000","last_change":"2024-08-17T02:46:48.090201+0000","last_active":"2024-08-17T02:46:48.092769+0000","last_peered":"2024-08-17T02:46:48.092769+0000","last_clean":"2024-08-17T02:46:48.092769+0000","last_became_active":"2024-08-17T02:46:48.088890+0000","last_became_peered":"2024-08-17T02:46:48.088890+0000","last_unstale":"2024-08-17T02:46:48.092769+0000","last_undegraded":"2024-08-17T02:46:48.092769+0000","last_fullsized":"2024-08-17T02:46:48.092769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:52.864560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105595+0000","last_change":"2024-08-17T02:46:49.105595+0000","last_active":"2024-08-17T02:46:49.105595+0000","last_peered":"2024-08-17T02:46:49.105595+0000","last_clean":"2024-08-17T02:46:49.105595+0000","last_became_active":"2024-08-17T02:46:49.104413+0000","last_became_peered":"2024-08-17T02:46:49.104413+0000","last_unstale":"2024-08-17T02:46:49.105595+0000","last_undegraded":"2024-08-17T02:46:49.105595+0000","last_fullsized":"2024-08-17T02:46:49.105595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096457+0000","last_change":"2024-08-17T02:46:48.078982+0000","last_active":"2024-08-17T02:46:49.096457+0000","last_peered":"2024-08-17T02:46:49.096457+0000","last_clean":"2024-08-17T02:46:49.096457+0000","last_became_active":"2024-08-17T02:46:48.078749+0000","last_became_peered":"2024-08-17T02:46:48.078749+0000","last_unstale":"2024-08-17T02:46:49.096457+0000","last_undegraded":"2024-08-17T02:46:49.096457+0000","last_fullsized":"2024-08-17T02:46:49.096457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082500+0000","last_change":"2024-08-17T02:46:49.082500+0000","last_active":"2024-08-17T02:46:49.082500+0000","last_peered":"2024-08-17T02:46:49.082500+0000","last_clean":"2024-08-17T02:46:49.082500+0000","last_became_active":"2024-08-17T02:46:49.081473+0000","last_became_peered":"2024-08-17T02:46:49.081473+0000","last_unstale":"2024-08-17T02:46:49.082500+0000","last_undegraded":"2024-08-17T02:46:49.082500+0000","last_fullsized":"2024-08-17T02:46:49.082500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068223+0000","last_change":"2024-08-17T02:46:48.087651+0000","last_active":"2024-08-17T02:46:49.068223+0000","last_peered":"2024-08-17T02:46:49.068223+0000","last_clean":"2024-08-17T02:46:49.068223+0000","last_became_active":"2024-08-17T02:46:48.086669+0000","last_became_peered":"2024-08-17T02:46:48.086669+0000","last_unstale":"2024-08-17T02:46:49.068223+0000","last_undegraded":"2024-08-17T02:46:49.068223+0000","last_fullsized":"2024-08-17T02:46:49.068223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:51.853156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083492+0000","last_change":"2024-08-17T02:46:49.083492+0000","last_active":"2024-08-17T02:46:49.083492+0000","last_peered":"2024-08-17T02:46:49.083492+0000","last_clean":"2024-08-17T02:46:49.083492+0000","last_became_active":"2024-08-17T02:46:49.083219+0000","last_became_peered":"2024-08-17T02:46:49.083219+0000","last_unstale":"2024-08-17T02:46:49.083492+0000","last_undegraded":"2024-08-17T02:46:49.083492+0000","last_fullsized":"2024-08-17T02:46:49.083492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087839+0000","last_change":"2024-08-17T02:46:48.077491+0000","last_active":"2024-08-17T02:46:49.087839+0000","last_peered":"2024-08-17T02:46:49.087839+0000","last_clean":"2024-08-17T02:46:49.087839+0000","last_became_active":"2024-08-17T02:46:48.076811+0000","last_became_peered":"2024-08-17T02:46:48.076811+0000","last_unstale":"2024-08-17T02:46:49.087839+0000","last_undegraded":"2024-08-17T02:46:49.087839+0000","last_fullsized":"2024-08-17T02:46:49.087839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.101717+0000","last_change":"2024-08-17T02:46:49.101717+0000","last_active":"2024-08-17T02:46:49.101717+0000","last_peered":"2024-08-17T02:46:49.101717+0000","last_clean":"2024-08-17T02:46:49.101717+0000","last_became_active":"2024-08-17T02:46:49.101402+0000","last_became_peered":"2024-08-17T02:46:49.101402+0000","last_unstale":"2024-08-17T02:46:49.101717+0000","last_undegraded":"2024-08-17T02:46:49.101717+0000","last_fullsized":"2024-08-17T02:46:49.101717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:31.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097911+0000","last_change":"2024-08-17T02:46:48.088763+0000","last_active":"2024-08-17T02:46:49.097911+0000","last_peered":"2024-08-17T02:46:49.097911+0000","last_clean":"2024-08-17T02:46:49.097911+0000","last_became_active":"2024-08-17T02:46:48.088515+0000","last_became_peered":"2024-08-17T02:46:48.088515+0000","last_unstale":"2024-08-17T02:46:49.097911+0000","last_undegraded":"2024-08-17T02:46:49.097911+0000","last_fullsized":"2024-08-17T02:46:49.097911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:47.407554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095108+0000","last_change":"2024-08-17T02:46:49.091638+0000","last_active":"2024-08-17T02:46:49.095108+0000","last_peered":"2024-08-17T02:46:49.095108+0000","last_clean":"2024-08-17T02:46:49.095108+0000","last_became_active":"2024-08-17T02:46:49.091395+0000","last_became_peered":"2024-08-17T02:46:49.091395+0000","last_unstale":"2024-08-17T02:46:49.095108+0000","last_undegraded":"2024-08-17T02:46:49.095108+0000","last_fullsized":"2024-08-17T02:46:49.095108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071417+0000","last_change":"2024-08-17T02:46:48.081129+0000","last_active":"2024-08-17T02:46:49.071417+0000","last_peered":"2024-08-17T02:46:49.071417+0000","last_clean":"2024-08-17T02:46:49.071417+0000","last_became_active":"2024-08-17T02:46:48.080849+0000","last_became_peered":"2024-08-17T02:46:48.080849+0000","last_unstale":"2024-08-17T02:46:49.071417+0000","last_undegraded":"2024-08-17T02:46:49.071417+0000","last_fullsized":"2024-08-17T02:46:49.071417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:37.122554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100757+0000","last_change":"2024-08-17T02:46:49.100757+0000","last_active":"2024-08-17T02:46:49.100757+0000","last_peered":"2024-08-17T02:46:49.100757+0000","last_clean":"2024-08-17T02:46:49.100757+0000","last_became_active":"2024-08-17T02:46:49.100157+0000","last_became_peered":"2024-08-17T02:46:49.100157+0000","last_unstale":"2024-08-17T02:46:49.100757+0000","last_undegraded":"2024-08-17T02:46:49.100757+0000","last_fullsized":"2024-08-17T02:46:49.100757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.081140+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:46:48.081140+0000","last_peered":"2024-08-17T02:46:48.081140+0000","last_clean":"2024-08-17T02:46:48.081140+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:46:48.081140+0000","last_undegraded":"2024-08-17T02:46:48.081140+0000","last_fullsized":"2024-08-17T02:46:48.081140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066868+0000","last_change":"2024-08-17T02:46:48.079170+0000","last_active":"2024-08-17T02:46:49.066868+0000","last_peered":"2024-08-17T02:46:49.066868+0000","last_clean":"2024-08-17T02:46:49.066868+0000","last_became_active":"2024-08-17T02:46:48.078398+0000","last_became_peered":"2024-08-17T02:46:48.078398+0000","last_unstale":"2024-08-17T02:46:49.066868+0000","last_undegraded":"2024-08-17T02:46:49.066868+0000","last_fullsized":"2024-08-17T02:46:49.066868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087841+0000","last_change":"2024-08-17T02:46:49.083909+0000","last_active":"2024-08-17T02:46:49.087841+0000","last_peered":"2024-08-17T02:46:49.087841+0000","last_clean":"2024-08-17T02:46:49.087841+0000","last_became_active":"2024-08-17T02:46:49.083625+0000","last_became_peered":"2024-08-17T02:46:49.083625+0000","last_unstale":"2024-08-17T02:46:49.087841+0000","last_undegraded":"2024-08-17T02:46:49.087841+0000","last_fullsized":"2024-08-17T02:46:49.087841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:36.672843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.096166+0000","last_change":"2024-08-17T02:46:48.091863+0000","last_active":"2024-08-17T02:46:48.096166+0000","last_peered":"2024-08-17T02:46:48.096166+0000","last_clean":"2024-08-17T02:46:48.096166+0000","last_became_active":"2024-08-17T02:46:48.091526+0000","last_became_peered":"2024-08-17T02:46:48.091526+0000","last_unstale":"2024-08-17T02:46:48.096166+0000","last_undegraded":"2024-08-17T02:46:48.096166+0000","last_fullsized":"2024-08-17T02:46:48.096166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:27.266794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087183+0000","last_change":"2024-08-17T02:46:49.087183+0000","last_active":"2024-08-17T02:46:49.087183+0000","last_peered":"2024-08-17T02:46:49.087183+0000","last_clean":"2024-08-17T02:46:49.087183+0000","last_became_active":"2024-08-17T02:46:49.086849+0000","last_became_peered":"2024-08-17T02:46:49.086849+0000","last_unstale":"2024-08-17T02:46:49.087183+0000","last_undegraded":"2024-08-17T02:46:49.087183+0000","last_fullsized":"2024-08-17T02:46:49.087183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071993+0000","last_change":"2024-08-17T02:46:48.084642+0000","last_active":"2024-08-17T02:46:49.071993+0000","last_peered":"2024-08-17T02:46:49.071993+0000","last_clean":"2024-08-17T02:46:49.071993+0000","last_became_active":"2024-08-17T02:46:48.084341+0000","last_became_peered":"2024-08-17T02:46:48.084341+0000","last_unstale":"2024-08-17T02:46:49.071993+0000","last_undegraded":"2024-08-17T02:46:49.071993+0000","last_fullsized":"2024-08-17T02:46:49.071993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095221+0000","last_change":"2024-08-17T02:46:49.088066+0000","last_active":"2024-08-17T02:46:49.095221+0000","last_peered":"2024-08-17T02:46:49.095221+0000","last_clean":"2024-08-17T02:46:49.095221+0000","last_became_active":"2024-08-17T02:46:49.084322+0000","last_became_peered":"2024-08-17T02:46:49.084322+0000","last_unstale":"2024-08-17T02:46:49.095221+0000","last_undegraded":"2024-08-17T02:46:49.095221+0000","last_fullsized":"2024-08-17T02:46:49.095221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068469+0000","last_change":"2024-08-17T02:46:48.081051+0000","last_active":"2024-08-17T02:46:49.068469+0000","last_peered":"2024-08-17T02:46:49.068469+0000","last_clean":"2024-08-17T02:46:49.068469+0000","last_became_active":"2024-08-17T02:46:48.080649+0000","last_became_peered":"2024-08-17T02:46:48.080649+0000","last_unstale":"2024-08-17T02:46:49.068469+0000","last_undegraded":"2024-08-17T02:46:49.068469+0000","last_fullsized":"2024-08-17T02:46:49.068469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094024+0000","last_change":"2024-08-17T02:46:49.094024+0000","last_active":"2024-08-17T02:46:49.094024+0000","last_peered":"2024-08-17T02:46:49.094024+0000","last_clean":"2024-08-17T02:46:49.094024+0000","last_became_active":"2024-08-17T02:46:49.093680+0000","last_became_peered":"2024-08-17T02:46:49.093680+0000","last_unstale":"2024-08-17T02:46:49.094024+0000","last_undegraded":"2024-08-17T02:46:49.094024+0000","last_fullsized":"2024-08-17T02:46:49.094024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:57.304010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063798+0000","last_change":"2024-08-17T02:46:48.078992+0000","last_active":"2024-08-17T02:46:49.063798+0000","last_peered":"2024-08-17T02:46:49.063798+0000","last_clean":"2024-08-17T02:46:49.063798+0000","last_became_active":"2024-08-17T02:46:48.078756+0000","last_became_peered":"2024-08-17T02:46:48.078756+0000","last_unstale":"2024-08-17T02:46:49.063798+0000","last_undegraded":"2024-08-17T02:46:49.063798+0000","last_fullsized":"2024-08-17T02:46:49.063798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:54.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095301+0000","last_change":"2024-08-17T02:46:49.088373+0000","last_active":"2024-08-17T02:46:49.095301+0000","last_peered":"2024-08-17T02:46:49.095301+0000","last_clean":"2024-08-17T02:46:49.095301+0000","last_became_active":"2024-08-17T02:46:49.087461+0000","last_became_peered":"2024-08-17T02:46:49.087461+0000","last_unstale":"2024-08-17T02:46:49.095301+0000","last_undegraded":"2024-08-17T02:46:49.095301+0000","last_fullsized":"2024-08-17T02:46:49.095301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.094135+0000","last_change":"2024-08-17T02:46:48.089957+0000","last_active":"2024-08-17T02:46:48.094135+0000","last_peered":"2024-08-17T02:46:48.094135+0000","last_clean":"2024-08-17T02:46:48.094135+0000","last_became_active":"2024-08-17T02:46:48.089649+0000","last_became_peered":"2024-08-17T02:46:48.089649+0000","last_unstale":"2024-08-17T02:46:48.094135+0000","last_undegraded":"2024-08-17T02:46:48.094135+0000","last_fullsized":"2024-08-17T02:46:48.094135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083036+0000","last_change":"2024-08-17T02:46:49.078454+0000","last_active":"2024-08-17T02:46:49.083036+0000","last_peered":"2024-08-17T02:46:49.083036+0000","last_clean":"2024-08-17T02:46:49.083036+0000","last_became_active":"2024-08-17T02:46:49.078210+0000","last_became_peered":"2024-08-17T02:46:49.078210+0000","last_unstale":"2024-08-17T02:46:49.083036+0000","last_undegraded":"2024-08-17T02:46:49.083036+0000","last_fullsized":"2024-08-17T02:46:49.083036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.064812+0000","last_change":"2024-08-17T02:46:48.077368+0000","last_active":"2024-08-17T02:46:49.064812+0000","last_peered":"2024-08-17T02:46:49.064812+0000","last_clean":"2024-08-17T02:46:49.064812+0000","last_became_active":"2024-08-17T02:46:48.077133+0000","last_became_peered":"2024-08-17T02:46:48.077133+0000","last_unstale":"2024-08-17T02:46:49.064812+0000","last_undegraded":"2024-08-17T02:46:49.064812+0000","last_fullsized":"2024-08-17T02:46:49.064812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103611+0000","last_change":"2024-08-17T02:46:49.101882+0000","last_active":"2024-08-17T02:46:49.103611+0000","last_peered":"2024-08-17T02:46:49.103611+0000","last_clean":"2024-08-17T02:46:49.103611+0000","last_became_active":"2024-08-17T02:46:49.101646+0000","last_became_peered":"2024-08-17T02:46:49.101646+0000","last_unstale":"2024-08-17T02:46:49.103611+0000","last_undegraded":"2024-08-17T02:46:49.103611+0000","last_fullsized":"2024-08-17T02:46:49.103611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103918+0000","last_change":"2024-08-17T02:46:48.081324+0000","last_active":"2024-08-17T02:46:49.103918+0000","last_peered":"2024-08-17T02:46:49.103918+0000","last_clean":"2024-08-17T02:46:49.103918+0000","last_became_active":"2024-08-17T02:46:48.078219+0000","last_became_peered":"2024-08-17T02:46:48.078219+0000","last_unstale":"2024-08-17T02:46:49.103918+0000","last_undegraded":"2024-08-17T02:46:49.103918+0000","last_fullsized":"2024-08-17T02:46:49.103918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.081991+0000","last_change":"2024-08-17T02:46:49.081991+0000","last_active":"2024-08-17T02:46:49.081991+0000","last_peered":"2024-08-17T02:46:49.081991+0000","last_clean":"2024-08-17T02:46:49.081991+0000","last_became_active":"2024-08-17T02:46:49.081605+0000","last_became_peered":"2024-08-17T02:46:49.081605+0000","last_unstale":"2024-08-17T02:46:49.081991+0000","last_undegraded":"2024-08-17T02:46:49.081991+0000","last_fullsized":"2024-08-17T02:46:49.081991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:09.169449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:48.091963+0000","last_change":"2024-08-17T02:46:48.087420+0000","last_active":"2024-08-17T02:46:48.091963+0000","last_peered":"2024-08-17T02:46:48.091963+0000","last_clean":"2024-08-17T02:46:48.091963+0000","last_became_active":"2024-08-17T02:46:48.087176+0000","last_became_peered":"2024-08-17T02:46:48.087176+0000","last_unstale":"2024-08-17T02:46:48.091963+0000","last_undegraded":"2024-08-17T02:46:48.091963+0000","last_fullsized":"2024-08-17T02:46:48.091963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:56.296792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079248+0000","last_change":"2024-08-17T02:46:49.079248+0000","last_active":"2024-08-17T02:46:49.079248+0000","last_peered":"2024-08-17T02:46:49.079248+0000","last_clean":"2024-08-17T02:46:49.079248+0000","last_became_active":"2024-08-17T02:46:49.078901+0000","last_became_peered":"2024-08-17T02:46:49.078901+0000","last_unstale":"2024-08-17T02:46:49.079248+0000","last_undegraded":"2024-08-17T02:46:49.079248+0000","last_fullsized":"2024-08-17T02:46:49.079248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:41.552959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063585+0000","last_change":"2024-08-17T02:46:48.087189+0000","last_active":"2024-08-17T02:46:49.063585+0000","last_peered":"2024-08-17T02:46:49.063585+0000","last_clean":"2024-08-17T02:46:49.063585+0000","last_became_active":"2024-08-17T02:46:48.086418+0000","last_became_peered":"2024-08-17T02:46:48.086418+0000","last_unstale":"2024-08-17T02:46:49.063585+0000","last_undegraded":"2024-08-17T02:46:49.063585+0000","last_fullsized":"2024-08-17T02:46:49.063585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:56.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.085453+0000","last_change":"2024-08-17T02:46:49.080433+0000","last_active":"2024-08-17T02:46:49.085453+0000","last_peered":"2024-08-17T02:46:49.085453+0000","last_clean":"2024-08-17T02:46:49.085453+0000","last_became_active":"2024-08-17T02:46:49.080054+0000","last_became_peered":"2024-08-17T02:46:49.080054+0000","last_unstale":"2024-08-17T02:46:49.085453+0000","last_undegraded":"2024-08-17T02:46:49.085453+0000","last_fullsized":"2024-08-17T02:46:49.085453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063075+0000","last_change":"2024-08-17T02:46:48.077229+0000","last_active":"2024-08-17T02:46:49.063075+0000","last_peered":"2024-08-17T02:46:49.063075+0000","last_clean":"2024-08-17T02:46:49.063075+0000","last_became_active":"2024-08-17T02:46:48.076984+0000","last_became_peered":"2024-08-17T02:46:48.076984+0000","last_unstale":"2024-08-17T02:46:49.063075+0000","last_undegraded":"2024-08-17T02:46:49.063075+0000","last_fullsized":"2024-08-17T02:46:49.063075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103538+0000","last_change":"2024-08-17T02:46:49.098807+0000","last_active":"2024-08-17T02:46:49.103538+0000","last_peered":"2024-08-17T02:46:49.103538+0000","last_clean":"2024-08-17T02:46:49.103538+0000","last_became_active":"2024-08-17T02:46:49.098544+0000","last_became_peered":"2024-08-17T02:46:49.098544+0000","last_unstale":"2024-08-17T02:46:49.103538+0000","last_undegraded":"2024-08-17T02:46:49.103538+0000","last_fullsized":"2024-08-17T02:46:49.103538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.102685+0000","last_change":"2024-08-17T02:46:48.093596+0000","last_active":"2024-08-17T02:46:49.102685+0000","last_peered":"2024-08-17T02:46:49.102685+0000","last_clean":"2024-08-17T02:46:49.102685+0000","last_became_active":"2024-08-17T02:46:48.093268+0000","last_became_peered":"2024-08-17T02:46:48.093268+0000","last_unstale":"2024-08-17T02:46:49.102685+0000","last_undegraded":"2024-08-17T02:46:49.102685+0000","last_fullsized":"2024-08-17T02:46:49.102685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.082223+0000","last_change":"2024-08-17T02:46:49.082223+0000","last_active":"2024-08-17T02:46:49.082223+0000","last_peered":"2024-08-17T02:46:49.082223+0000","last_clean":"2024-08-17T02:46:49.082223+0000","last_became_active":"2024-08-17T02:46:49.081793+0000","last_became_peered":"2024-08-17T02:46:49.081793+0000","last_unstale":"2024-08-17T02:46:49.082223+0000","last_undegraded":"2024-08-17T02:46:49.082223+0000","last_fullsized":"2024-08-17T02:46:49.082223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079110+0000","last_change":"2024-08-17T02:46:49.074753+0000","last_active":"2024-08-17T02:46:49.079110+0000","last_peered":"2024-08-17T02:46:49.079110+0000","last_clean":"2024-08-17T02:46:49.079110+0000","last_became_active":"2024-08-17T02:46:49.074319+0000","last_became_peered":"2024-08-17T02:46:49.074319+0000","last_unstale":"2024-08-17T02:46:49.079110+0000","last_undegraded":"2024-08-17T02:46:49.079110+0000","last_fullsized":"2024-08-17T02:46:49.079110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103869+0000","last_change":"2024-08-17T02:46:48.091988+0000","last_active":"2024-08-17T02:46:49.103869+0000","last_peered":"2024-08-17T02:46:49.103869+0000","last_clean":"2024-08-17T02:46:49.103869+0000","last_became_active":"2024-08-17T02:46:48.091617+0000","last_became_peered":"2024-08-17T02:46:48.091617+0000","last_unstale":"2024-08-17T02:46:49.103869+0000","last_undegraded":"2024-08-17T02:46:49.103869+0000","last_fullsized":"2024-08-17T02:46:49.103869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080144+0000","last_change":"2024-08-17T02:46:49.078397+0000","last_active":"2024-08-17T02:46:49.080144+0000","last_peered":"2024-08-17T02:46:49.080144+0000","last_clean":"2024-08-17T02:46:49.080144+0000","last_became_active":"2024-08-17T02:46:49.078122+0000","last_became_peered":"2024-08-17T02:46:49.078122+0000","last_unstale":"2024-08-17T02:46:49.080144+0000","last_undegraded":"2024-08-17T02:46:49.080144+0000","last_fullsized":"2024-08-17T02:46:49.080144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104707+0000","last_change":"2024-08-17T02:46:48.092015+0000","last_active":"2024-08-17T02:46:49.104707+0000","last_peered":"2024-08-17T02:46:49.104707+0000","last_clean":"2024-08-17T02:46:49.104707+0000","last_became_active":"2024-08-17T02:46:48.091717+0000","last_became_peered":"2024-08-17T02:46:48.091717+0000","last_unstale":"2024-08-17T02:46:49.104707+0000","last_undegraded":"2024-08-17T02:46:49.104707+0000","last_fullsized":"2024-08-17T02:46:49.104707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:40.545742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.089752+0000","last_change":"2024-08-17T02:46:49.089752+0000","last_active":"2024-08-17T02:46:49.089752+0000","last_peered":"2024-08-17T02:46:49.089752+0000","last_clean":"2024-08-17T02:46:49.089752+0000","last_became_active":"2024-08-17T02:46:49.089497+0000","last_became_peered":"2024-08-17T02:46:49.089497+0000","last_unstale":"2024-08-17T02:46:49.089752+0000","last_undegraded":"2024-08-17T02:46:49.089752+0000","last_fullsized":"2024-08-17T02:46:49.089752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.098272+0000","last_change":"2024-08-17T02:46:48.082388+0000","last_active":"2024-08-17T02:46:49.098272+0000","last_peered":"2024-08-17T02:46:49.098272+0000","last_clean":"2024-08-17T02:46:49.098272+0000","last_became_active":"2024-08-17T02:46:48.082137+0000","last_became_peered":"2024-08-17T02:46:48.082137+0000","last_unstale":"2024-08-17T02:46:49.098272+0000","last_undegraded":"2024-08-17T02:46:49.098272+0000","last_fullsized":"2024-08-17T02:46:49.098272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100362+0000","last_change":"2024-08-17T02:46:49.091589+0000","last_active":"2024-08-17T02:46:49.100362+0000","last_peered":"2024-08-17T02:46:49.100362+0000","last_clean":"2024-08-17T02:46:49.100362+0000","last_became_active":"2024-08-17T02:46:49.091354+0000","last_became_peered":"2024-08-17T02:46:49.091354+0000","last_unstale":"2024-08-17T02:46:49.100362+0000","last_undegraded":"2024-08-17T02:46:49.100362+0000","last_fullsized":"2024-08-17T02:46:49.100362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103909+0000","last_change":"2024-08-17T02:46:48.081234+0000","last_active":"2024-08-17T02:46:49.103909+0000","last_peered":"2024-08-17T02:46:49.103909+0000","last_clean":"2024-08-17T02:46:49.103909+0000","last_became_active":"2024-08-17T02:46:48.081039+0000","last_became_peered":"2024-08-17T02:46:48.081039+0000","last_unstale":"2024-08-17T02:46:49.103909+0000","last_undegraded":"2024-08-17T02:46:49.103909+0000","last_fullsized":"2024-08-17T02:46:49.103909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":806912,"data_stored":661138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":76578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":70326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":76488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1390000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1789999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":815104,"data_stored":661194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:53.626 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:46:53.627 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:46:53.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:46:53.627 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:46:53.627 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.810+0000 7fb416400640 1 Processor -- start 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.810+0000 7fb416400640 1 -- start start 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb416400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100ca350 0x7fb4100cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb416400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4100ca720 0x7fb4100cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb416400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4100cb730 con 0x7fb4100cab30 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb416400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100cf9c0 con 0x7fb4100ca720 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb416400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100cb0e0 con 0x7fb4100ca350 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb415a00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb4100cab30 0x7fb4100cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35552/0 (socket says 172.21.15.149:35552) 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb415a00640 1 -- 172.21.15.149:0/419242959 learned_addr learned my addr 172.21.15.149:0/419242959 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb415000640 1 --2- 172.21.15.149:0/419242959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100ca350 0x7fb4100cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb40fe00640 1 --2- 172.21.15.149:0/419242959 >> v2:172.21.15.161:3300/0 conn(0x7fb4100ca720 0x7fb4100cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.812+0000 7fb40f400640 1 -- 172.21.15.149:0/419242959 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901687390 0 0) 0x7fb4100cb730 con 0x7fb4100cab30 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.813+0000 7fb40f400640 1 -- 172.21.15.149:0/419242959 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f40034e0 con 0x7fb4100cab30 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.813+0000 7fb415000640 1 -- 172.21.15.149:0/419242959 >> v2:172.21.15.161:3300/0 conn(0x7fb4100ca720 msgr2=0x7fb4100cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.813+0000 7fb415000640 1 --2- 172.21.15.149:0/419242959 >> v2:172.21.15.161:3300/0 conn(0x7fb4100ca720 0x7fb4100cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.813+0000 7fb415000640 1 -- 172.21.15.149:0/419242959 >> v1:172.21.15.149:6789/0 conn(0x7fb4100cab30 legacy=0x7fb4100cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.813+0000 7fb415000640 1 -- 172.21.15.149:0/419242959 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100cb3c0 con 0x7fb4100ca350 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.814+0000 7fb415000640 1 --2- 172.21.15.149:0/419242959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100ca350 0x7fb4100cf2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb400009850 tx=0x7fb4000090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b87d57eb7847413 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.814+0000 7fb40f400640 1 -- 172.21.15.149:0/419242959 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40002ad80 con 0x7fb4100ca350 2024-08-17T02:46:53.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.814+0000 7fb40f400640 1 -- 172.21.15.149:0/419242959 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400032440 con 0x7fb4100ca350 2024-08-17T02:46:53.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.814+0000 7fb40f400640 1 -- 172.21.15.149:0/419242959 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400032800 con 0x7fb4100ca350 2024-08-17T02:46:53.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 -- 172.21.15.149:0/419242959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100ca350 msgr2=0x7fb4100cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 --2- 172.21.15.149:0/419242959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100ca350 0x7fb4100cf2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb400009850 tx=0x7fb4000090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 -- 172.21.15.149:0/419242959 shutdown_connections 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 --2- 172.21.15.149:0/419242959 >> v2:172.21.15.161:3300/0 conn(0x7fb4100ca720 0x7fb4100cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 --2- 172.21.15.149:0/419242959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100ca350 0x7fb4100cf2d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 -- 172.21.15.149:0/419242959 >> 172.21.15.149:0/419242959 conn(0x7fb4100cfdb0 msgr2=0x7fb4100d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 -- 172.21.15.149:0/419242959 shutdown_connections 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 -- 172.21.15.149:0/419242959 wait complete. 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.816+0000 7fb416400640 1 Processor -- start 2024-08-17T02:46:53.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.817+0000 7fb416400640 1 -- start start 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.817+0000 7fb416400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 0x7fb4100c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb416400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4100ca720 0x7fb4100b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb416400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100cab30 0x7fb410156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb416400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb410099af0 con 0x7fb4100ca350 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb416400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100b02f0 con 0x7fb4100ca720 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb416400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100aef70 con 0x7fb4100cab30 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 0x7fb4100c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 0x7fb4100c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47992/0 (socket says 172.21.15.149:47992) 2024-08-17T02:46:53.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 -- 172.21.15.149:0/3295785236 learned_addr learned my addr 172.21.15.149:0/3295785236 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 -- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100cab30 msgr2=0x7fb410156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100cab30 0x7fb410156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 -- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4100ca720 msgr2=0x7fb4100b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb40fe00640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4100ca720 0x7fb4100b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4100ca720 0x7fb4100b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 -- 172.21.15.149:0/3295785236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb400009390 con 0x7fb4100ca350 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb40fe00640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4100ca720 0x7fb4100b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.818+0000 7fb415000640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 0x7fb4100c8d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb400009850 tx=0x7fb400032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.819+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400031830 con 0x7fb4100ca350 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.819+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400031990 con 0x7fb4100ca350 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.819+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400031d70 con 0x7fb4100ca350 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.819+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4100af250 con 0x7fb4100ca350 2024-08-17T02:46:53.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.819+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4100af5e0 con 0x7fb4100ca350 2024-08-17T02:46:53.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.820+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb410071050 con 0x7fb4100ca350 2024-08-17T02:46:53.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.821+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb40003e660 con 0x7fb4100ca350 2024-08-17T02:46:53.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.821+0000 7fb407e00640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb3f0065150 0x7fb3f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.822+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4000a2490 con 0x7fb4100ca350 2024-08-17T02:46:53.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.822+0000 7fb40fe00640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb3f0065150 0x7fb3f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.822+0000 7fb40fe00640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb3f0065150 0x7fb3f0067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc006e70 tx=0x7fb3fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:53.826+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb400070560 con 0x7fb4100ca350 2024-08-17T02:46:54.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.043+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb4100d0ac0 con 0x7fb4100ca350 2024-08-17T02:46:54.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.046+0000 7fb407e00640 1 -- 172.21.15.149:0/3295785236 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161037 (secure 0 0 0) 0x7fb400073b80 con 0x7fb4100ca350 2024-08-17T02:46:54.050 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:54.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.050+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb3f0065150 msgr2=0x7fb3f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.050+0000 7fb416400640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb3f0065150 0x7fb3f0067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc006e70 tx=0x7fb3fc008040 comp rx=0 tx=0).stop 2024-08-17T02:46:54.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.050+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 msgr2=0x7fb4100c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.050+0000 7fb416400640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 0x7fb4100c8d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb400009850 tx=0x7fb400032000 comp rx=0 tx=0).stop 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 shutdown_connections 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb3f0065150 0x7fb3f0067600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4100cab30 0x7fb410156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4100ca720 0x7fb4100b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 --2- 172.21.15.149:0/3295785236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4100ca350 0x7fb4100c8d90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 >> 172.21.15.149:0/3295785236 conn(0x7fb4100cfdb0 msgr2=0x7fb4100ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 shutdown_connections 2024-08-17T02:46:54.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.051+0000 7fb416400640 1 -- 172.21.15.149:0/3295785236 wait complete. 2024-08-17T02:46:54.066 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":36958},{"type":"v1","addr":"172.21.15.149:6833","nonce":36958}]},"active_addr":"172.21.15.149:6833/36958","active_change":"2024-08-17T02:46:27.612333+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":1684861887}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2712159359}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2149280475}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":125182768}]}]} 2024-08-17T02:46:54.069 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:46:54.070 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:46:54.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.219+0000 7f5d62200640 1 Processor -- start 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.219+0000 7f5d62200640 1 -- start start 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.220+0000 7f5d62200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.220+0000 7f5d62200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5d5c06df00 0x7f5d5c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.220+0000 7f5d62200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c156670 con 0x7f5d5c155df0 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d62200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b0350 con 0x7f5d5c06df00 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d62200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c06e5e0 con 0x7f5d5c155a20 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d5b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d5be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5d5c06df00 0x7f5d5c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d5b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:50916/0 (socket says 172.21.15.149:50916) 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d5b400640 1 -- 172.21.15.149:0/2665135072 learned_addr learned my addr 172.21.15.149:0/2665135072 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.221+0000 7f5d52a00640 1 --1- 172.21.15.149:0/2665135072 >> v1:172.21.15.161:6789/0 conn(0x7f5d5c155df0 0x7f5d5c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35470/0 (socket says 172.21.15.149:35470) 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.222+0000 7f5d5b400640 1 -- 172.21.15.149:0/2665135072 >> v2:172.21.15.161:3300/0 conn(0x7f5d5c06df00 msgr2=0x7f5d5c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.222+0000 7f5d5b400640 1 --2- 172.21.15.149:0/2665135072 >> v2:172.21.15.161:3300/0 conn(0x7f5d5c06df00 0x7f5d5c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.222+0000 7f5d5b400640 1 -- 172.21.15.149:0/2665135072 >> v1:172.21.15.161:6789/0 conn(0x7f5d5c155df0 legacy=0x7f5d5c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.222+0000 7f5d5b400640 1 -- 172.21.15.149:0/2665135072 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c06e8c0 con 0x7f5d5c155a20 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.222+0000 7f5d5be00640 1 --2- 172.21.15.149:0/2665135072 >> v2:172.21.15.161:3300/0 conn(0x7f5d5c06df00 0x7f5d5c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.223+0000 7f5d5b400640 1 --2- 172.21.15.149:0/2665135072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c0adf10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009910 tx=0x7f5d4c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bce1db742cb44c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.223+0000 7f5d5aa00640 1 -- 172.21.15.149:0/2665135072 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c02ae40 con 0x7f5d5c155a20 2024-08-17T02:46:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.223+0000 7f5d5aa00640 1 -- 172.21.15.149:0/2665135072 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c032440 con 0x7f5d5c155a20 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.223+0000 7f5d5aa00640 1 -- 172.21.15.149:0/2665135072 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c032820 con 0x7f5d5c155a20 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 -- 172.21.15.149:0/2665135072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 msgr2=0x7f5d5c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 --2- 172.21.15.149:0/2665135072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c0adf10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009910 tx=0x7f5d4c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 -- 172.21.15.149:0/2665135072 shutdown_connections 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 --2- 172.21.15.149:0/2665135072 >> v2:172.21.15.161:3300/0 conn(0x7f5d5c06df00 0x7f5d5c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 --2- 172.21.15.149:0/2665135072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c0adf10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 -- 172.21.15.149:0/2665135072 >> 172.21.15.149:0/2665135072 conn(0x7f5d5c0cb9b0 msgr2=0x7f5d5c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 -- 172.21.15.149:0/2665135072 shutdown_connections 2024-08-17T02:46:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.224+0000 7f5d62200640 1 -- 172.21.15.149:0/2665135072 wait complete. 2024-08-17T02:46:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.225+0000 7f5d62200640 1 Processor -- start 2024-08-17T02:46:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.225+0000 7f5d62200640 1 -- start start 2024-08-17T02:46:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d62200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 0x7f5d5c0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d62200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d62200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d5c155df0 0x7f5d5c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d62200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c14dfb0 con 0x7f5d5c06df00 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d62200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c167dd0 con 0x7f5d5c155df0 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d62200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c14d610 con 0x7f5d5c155a20 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d5b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 0x7f5d5c0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d5b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 0x7f5d5c0acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:47996/0 (socket says 172.21.15.149:47996) 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d5b400640 1 -- 172.21.15.149:0/3183871770 learned_addr learned my addr 172.21.15.149:0/3183871770 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d52a00640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.226+0000 7f5d5be00640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d5c155df0 0x7f5d5c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d5b400640 1 -- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 msgr2=0x7f5d5c153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d5b400640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d5b400640 1 -- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d5c155df0 msgr2=0x7f5d5c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d5b400640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d5c155df0 0x7f5d5c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d5b400640 1 -- 172.21.15.149:0/3183871770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54009a20 con 0x7f5d5c06df00 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d5b400640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 0x7f5d5c0acc90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c035040 tx=0x7f5d4c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c031c80 con 0x7f5d5c06df00 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c031e40 con 0x7f5d5c06df00 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c03d670 con 0x7f5d5c06df00 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.227+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c009450 con 0x7f5d5c06df00 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.228+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c14dbd0 con 0x7f5d5c06df00 2024-08-17T02:46:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.228+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5c064db0 con 0x7f5d5c06df00 2024-08-17T02:46:54.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.229+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d4c039040 con 0x7f5d5c06df00 2024-08-17T02:46:54.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.230+0000 7f5d53400640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5d38065180 0x7f5d38067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.230+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d4c02ae40 con 0x7f5d5c06df00 2024-08-17T02:46:54.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.230+0000 7f5d52a00640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5d38065180 0x7f5d38067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.231+0000 7f5d52a00640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5d38065180 0x7f5d38067630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0add70 tx=0x7f5d44007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.234+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5d4c0d3e40 con 0x7f5d5c06df00 2024-08-17T02:46:54.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.408+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d5c151b60 con 0x7f5d5c06df00 2024-08-17T02:46:54.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.409+0000 7f5d53400640 1 -- 172.21.15.149:0/3183871770 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5d4c0702d0 con 0x7f5d5c06df00 2024-08-17T02:46:54.410 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:54.410 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5d38065180 msgr2=0x7f5d38067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5d38065180 0x7f5d38067630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0add70 tx=0x7f5d44007e20 comp rx=0 tx=0).stop 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 msgr2=0x7f5d5c0acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 0x7f5d5c0acc90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c035040 tx=0x7f5d4c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 shutdown_connections 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5d38065180 0x7f5d38067630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d5c155df0 0x7f5d5c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d5c155a20 0x7f5d5c153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 --2- 172.21.15.149:0/3183871770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d5c06df00 0x7f5d5c0acc90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 >> 172.21.15.149:0/3183871770 conn(0x7f5d5c0cb9b0 msgr2=0x7f5d5c150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 shutdown_connections 2024-08-17T02:46:54.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.412+0000 7f5d62200640 1 -- 172.21.15.149:0/3183871770 wait complete. 2024-08-17T02:46:54.428 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:46:54.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:54.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.576+0000 7f082a000640 1 Processor -- start 2024-08-17T02:46:54.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.576+0000 7f082a000640 1 -- start start 2024-08-17T02:46:54.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.577+0000 7f082a000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08241401b0 0x7f08240caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.577+0000 7f082a000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0824140580 0x7f08240b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.577+0000 7f082a000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240b16d0 con 0x7f08240b1270 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.577+0000 7f082a000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240cb450 con 0x7f08241401b0 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.577+0000 7f082a000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240caa80 con 0x7f0824140580 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08241401b0 0x7f08240caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08241401b0 0x7f08240caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48004/0 (socket says 172.21.15.149:48004) 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 -- 172.21.15.149:0/3209159966 learned_addr learned my addr 172.21.15.149:0/3209159966 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0822a00640 1 --2- 172.21.15.149:0/3209159966 >> v2:172.21.15.161:3300/0 conn(0x7f0824140580 0x7f08240b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 -- 172.21.15.149:0/3209159966 >> v2:172.21.15.161:3300/0 conn(0x7f0824140580 msgr2=0x7f08240b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 --2- 172.21.15.149:0/3209159966 >> v2:172.21.15.161:3300/0 conn(0x7f0824140580 0x7f08240b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 -- 172.21.15.149:0/3209159966 >> v1:172.21.15.161:6789/0 conn(0x7f08240b1270 legacy=0x7f08240c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.578+0000 7f0823400640 1 -- 172.21.15.149:0/3209159966 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240c9e70 con 0x7f08241401b0 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.579+0000 7f0823400640 1 --2- 172.21.15.149:0/3209159966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240caf10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f082406aa80 tx=0x7f08140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df24aae2440ec25a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.579+0000 7f0822000640 1 -- 172.21.15.149:0/3209159966 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081402adf0 con 0x7f08241401b0 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.579+0000 7f0822000640 1 -- 172.21.15.149:0/3209159966 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0814032440 con 0x7f08241401b0 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.579+0000 7f0822000640 1 -- 172.21.15.149:0/3209159966 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814032820 con 0x7f08241401b0 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 -- 172.21.15.149:0/3209159966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 msgr2=0x7f08240caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 --2- 172.21.15.149:0/3209159966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240caf10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f082406aa80 tx=0x7f08140091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 -- 172.21.15.149:0/3209159966 shutdown_connections 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 --2- 172.21.15.149:0/3209159966 >> v2:172.21.15.161:3300/0 conn(0x7f0824140580 0x7f08240b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 --2- 172.21.15.149:0/3209159966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240caf10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 -- 172.21.15.149:0/3209159966 >> 172.21.15.149:0/3209159966 conn(0x7f08240cb9b0 msgr2=0x7f08240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 -- 172.21.15.149:0/3209159966 shutdown_connections 2024-08-17T02:46:54.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.580+0000 7f082a000640 1 -- 172.21.15.149:0/3209159966 wait complete. 2024-08-17T02:46:54.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.581+0000 7f082a000640 1 Processor -- start 2024-08-17T02:46:54.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 -- start start 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08240b1270 0x7f08241691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0824140580 0x7f0824131e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824157110 con 0x7f08241401b0 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824169b20 con 0x7f0824140580 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.582+0000 7f082a000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0824169e00 con 0x7f08240b1270 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48014/0 (socket says 172.21.15.149:48014) 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 -- 172.21.15.149:0/2233360024 learned_addr learned my addr 172.21.15.149:0/2233360024 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0823400640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08240b1270 0x7f08241691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 -- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08240b1270 msgr2=0x7f08241691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08240b1270 0x7f08241691b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 -- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0824140580 msgr2=0x7f0824131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0823e00640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0824140580 0x7f0824131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0824140580 0x7f0824131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 -- 172.21.15.149:0/2233360024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814009450 con 0x7f08241401b0 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0823400640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08240b1270 0x7f08241691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0823e00640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0824140580 0x7f0824131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.583+0000 7f0822a00640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240699e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f081000ea20 tx=0x7f08100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.584+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000ca10 con 0x7f08241401b0 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.584+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081000cb70 con 0x7f08241401b0 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.584+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810013470 con 0x7f08241401b0 2024-08-17T02:46:54.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.584+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08241573b0 con 0x7f08241401b0 2024-08-17T02:46:54.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.584+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082416a380 con 0x7f08241401b0 2024-08-17T02:46:54.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.585+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824064db0 con 0x7f08241401b0 2024-08-17T02:46:54.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.586+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0810013860 con 0x7f08241401b0 2024-08-17T02:46:54.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.587+0000 7f081aa00640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0804065150 0x7f0804067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.587+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08100827e0 con 0x7f08241401b0 2024-08-17T02:46:54.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.587+0000 7f0823400640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0804065150 0x7f0804067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.587+0000 7f0823400640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0804065150 0x7f0804067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0814034000 tx=0x7f0814032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.590+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0810050800 con 0x7f08241401b0 2024-08-17T02:46:54.762 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.762+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08240ac9a0 con 0x7f08241401b0 2024-08-17T02:46:54.763 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.763+0000 7f081aa00640 1 -- 172.21.15.149:0/2233360024 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f0810053e20 con 0x7f08241401b0 2024-08-17T02:46:54.763 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:54.764 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0804065150 msgr2=0x7f0804067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0804065150 0x7f0804067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0814034000 tx=0x7f0814032000 comp rx=0 tx=0).stop 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 msgr2=0x7f08240699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240699e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f081000ea20 tx=0x7f08100090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 shutdown_connections 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0804065150 0x7f0804067600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0824140580 0x7f0824131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08241401b0 0x7f08240699e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 --2- 172.21.15.149:0/2233360024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08240b1270 0x7f08241691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.767 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 >> 172.21.15.149:0/2233360024 conn(0x7f08240cb9b0 msgr2=0x7f08240ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.767 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 shutdown_connections 2024-08-17T02:46:54.767 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:54.765+0000 7f082a000640 1 -- 172.21.15.149:0/2233360024 wait complete. 2024-08-17T02:46:54.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:46:54.782 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:46:54.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:46:54.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:46:54.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:46:54.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:46:54.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:46:54.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:46:55.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.048+0000 7f039f200640 1 Processor -- start 2024-08-17T02:46:55.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.048+0000 7f365ca00640 1 Processor -- start 2024-08-17T02:46:55.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.048+0000 7f039f200640 1 -- start start 2024-08-17T02:46:55.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.049+0000 7f365ca00640 1 -- start start 2024-08-17T02:46:55.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.050+0000 7f039f200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e5c30 0x7f03980e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.050+0000 7f039f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0398006c10 con 0x7f0398054d00 2024-08-17T02:46:55.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.050+0000 7f039f200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0398006ef0 con 0x7f03980e1bd0 2024-08-17T02:46:55.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.050+0000 7f039f200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980e65f0 con 0x7f03980e5c30 2024-08-17T02:46:55.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.050+0000 7f365ca00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f365813e360 0x7f36580adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f039e800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e5c30 0x7f03980e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f365ca00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 0x7f3658069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f365ca00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36580af6e0 con 0x7f365806e7f0 2024-08-17T02:46:55.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f365ca00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580acb40 con 0x7f365813e360 2024-08-17T02:46:55.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f365ca00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580ad6c0 con 0x7f365813e730 2024-08-17T02:46:55.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f039de00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f03980e1bd0 0x7f03980e1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35484/0 (socket says 172.21.15.149:35484) 2024-08-17T02:46:55.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f039de00640 1 -- 172.21.15.149:0/3004229974 learned_addr learned my addr 172.21.15.149:0/3004229974 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f039e800640 1 -- 172.21.15.149:0/3004229974 >> v1:172.21.15.161:6789/0 conn(0x7f03980e1bd0 legacy=0x7f03980e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f039e800640 1 -- 172.21.15.149:0/3004229974 >> v1:172.21.15.149:6789/0 conn(0x7f0398054d00 legacy=0x7f0398006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f3655e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f365813e360 0x7f36580adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f3655e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f365813e360 0x7f36580adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48026/0 (socket says 172.21.15.149:48026) 2024-08-17T02:46:55.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f3655e00640 1 -- 172.21.15.149:0/3584609640 learned_addr learned my addr 172.21.15.149:0/3584609640 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f3655400640 1 --2- 172.21.15.149:0/3584609640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 0x7f3658069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.051+0000 7f039d400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0398054d00 0x7f0398006150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35564/0 (socket says 172.21.15.149:35564) 2024-08-17T02:46:55.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f3654a00640 1 -- 172.21.15.149:0/3584609640 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919396899 0 0) 0x7f36580af6e0 con 0x7f365806e7f0 2024-08-17T02:46:55.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f3655e00640 1 -- 172.21.15.149:0/3584609640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 msgr2=0x7f3658069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f3655e00640 1 --2- 172.21.15.149:0/3584609640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 0x7f3658069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f3655e00640 1 -- 172.21.15.149:0/3584609640 >> v1:172.21.15.149:6789/0 conn(0x7f365806e7f0 legacy=0x7f36580aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f3655e00640 1 -- 172.21.15.149:0/3584609640 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580acd90 con 0x7f365813e360 2024-08-17T02:46:55.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.052+0000 7f039e800640 1 -- 172.21.15.149:0/3004229974 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980071d0 con 0x7f03980e5c30 2024-08-17T02:46:55.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.053+0000 7f64e5600640 1 Processor -- start 2024-08-17T02:46:55.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.053+0000 7f64e5600640 1 -- start start 2024-08-17T02:46:55.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.054+0000 7f3655e00640 1 --2- 172.21.15.149:0/3584609640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f365813e360 0x7f36580adb50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3648009910 tx=0x7f36480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f6a967d9fee500 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.054+0000 7f039e800640 1 --2- 172.21.15.149:0/3004229974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e5c30 0x7f03980e60b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f038c009880 tx=0x7f038c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=469a2637ca1ec18f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f039ca00640 1 -- 172.21.15.149:0/3004229974 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c02ad70 con 0x7f03980e5c30 2024-08-17T02:46:55.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f64e5600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64d80ddd90 0x7f64d80de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f64e5600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64d800c040 0x7f64d8034160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f3654a00640 1 -- 172.21.15.149:0/3584609640 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364802ae60 con 0x7f365813e360 2024-08-17T02:46:55.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f3654a00640 1 -- 172.21.15.149:0/3584609640 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3648032440 con 0x7f365813e360 2024-08-17T02:46:55.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f3654a00640 1 -- 172.21.15.149:0/3584609640 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36480327e0 con 0x7f365813e360 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f64e5600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d8054130 con 0x7f64d8053020 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f64e5600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d8053520 con 0x7f64d80ddd90 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f64e5600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d8053800 con 0x7f64d800c040 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f64dfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64d80ddd90 0x7f64d80de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f64dfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64d80ddd90 0x7f64d80de160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48042/0 (socket says 172.21.15.149:48042) 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f64dfe00640 1 -- 172.21.15.149:0/3021118255 learned_addr learned my addr 172.21.15.149:0/3021118255 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f64df400640 1 --2- 172.21.15.149:0/3021118255 >> v2:172.21.15.161:3300/0 conn(0x7f64d800c040 0x7f64d8034160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f039ca00640 1 -- 172.21.15.149:0/3004229974 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c032440 con 0x7f03980e5c30 2024-08-17T02:46:55.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7fc965800640 1 Processor -- start 2024-08-17T02:46:55.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7fc965800640 1 -- start start 2024-08-17T02:46:55.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.055+0000 7f039ca00640 1 -- 172.21.15.149:0/3004229974 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c032820 con 0x7f03980e5c30 2024-08-17T02:46:55.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f64dfe00640 1 -- 172.21.15.149:0/3021118255 >> v2:172.21.15.161:3300/0 conn(0x7f64d800c040 msgr2=0x7f64d8034160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f64dfe00640 1 --2- 172.21.15.149:0/3021118255 >> v2:172.21.15.161:3300/0 conn(0x7f64d800c040 0x7f64d8034160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f64dfe00640 1 -- 172.21.15.149:0/3021118255 >> v1:172.21.15.161:6789/0 conn(0x7f64d8053020 legacy=0x7f64d804fbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:55.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f64dfe00640 1 -- 172.21.15.149:0/3021118255 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8053ae0 con 0x7f64d80ddd90 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f039f200640 1 -- 172.21.15.149:0/3004229974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e5c30 msgr2=0x7f03980e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f039f200640 1 --2- 172.21.15.149:0/3004229974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e5c30 0x7f03980e60b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f038c009880 tx=0x7f038c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f039f200640 1 -- 172.21.15.149:0/3004229974 shutdown_connections 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f039f200640 1 --2- 172.21.15.149:0/3004229974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e5c30 0x7f03980e60b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f039f200640 1 -- 172.21.15.149:0/3004229974 >> 172.21.15.149:0/3004229974 conn(0x7f039800f070 msgr2=0x7f0398058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f039f200640 1 -- 172.21.15.149:0/3004229974 shutdown_connections 2024-08-17T02:46:55.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f039f200640 1 -- 172.21.15.149:0/3004229974 wait complete. 2024-08-17T02:46:55.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f365ca00640 1 -- 172.21.15.149:0/3584609640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f365813e360 msgr2=0x7f36580adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.056+0000 7f365ca00640 1 --2- 172.21.15.149:0/3584609640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f365813e360 0x7f36580adb50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3648009910 tx=0x7f36480091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f365ca00640 1 -- 172.21.15.149:0/3584609640 shutdown_connections 2024-08-17T02:46:55.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f365ca00640 1 --2- 172.21.15.149:0/3584609640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 0x7f3658069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f365ca00640 1 --2- 172.21.15.149:0/3584609640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f365813e360 0x7f36580adb50 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3648009910 tx=0x7f36480091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.057+0000 7f365ca00640 1 -- 172.21.15.149:0/3584609640 >> 172.21.15.149:0/3584609640 conn(0x7f36580cc480 msgr2=0x7f36580687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.058+0000 7f365ca00640 1 -- 172.21.15.149:0/3584609640 shutdown_connections 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.058+0000 7f64dfe00640 1 --2- 172.21.15.149:0/3021118255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d80ddd90 0x7f64d80de160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64e0065800 tx=0x7f64e006f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98bdb2cb3982d86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.058+0000 7f64dea00640 1 -- 172.21.15.149:0/3021118255 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00a65e0 con 0x7f64d80ddd90 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7f64dea00640 1 -- 172.21.15.149:0/3021118255 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e00a4050 con 0x7f64d80ddd90 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7f64dea00640 1 -- 172.21.15.149:0/3021118255 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00a6990 con 0x7f64d80ddd90 2024-08-17T02:46:55.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7f365ca00640 1 -- 172.21.15.149:0/3584609640 wait complete. 2024-08-17T02:46:55.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7f039f200640 1 Processor -- start 2024-08-17T02:46:55.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f039f200640 1 -- start start 2024-08-17T02:46:55.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f64e5600640 1 -- 172.21.15.149:0/3021118255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d80ddd90 msgr2=0x7f64d80de160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f64e5600640 1 --2- 172.21.15.149:0/3021118255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d80ddd90 0x7f64d80de160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64e0065800 tx=0x7f64e006f710 comp rx=0 tx=0).stop 2024-08-17T02:46:55.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f64e5600640 1 -- 172.21.15.149:0/3021118255 shutdown_connections 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f64e5600640 1 --2- 172.21.15.149:0/3021118255 >> v2:172.21.15.161:3300/0 conn(0x7f64d800c040 0x7f64d8034160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f64e5600640 1 --2- 172.21.15.149:0/3021118255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d80ddd90 0x7f64d80de160 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7f64e5600640 1 -- 172.21.15.149:0/3021118255 >> 172.21.15.149:0/3021118255 conn(0x7f64d8009fa0 msgr2=0x7f64d800a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7fc965800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9600c6a30 0x7fc9600cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7fc95ea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc960159060 0x7fc9600cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35578/0 (socket says 172.21.15.149:35578) 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7fc95ea00640 1 -- 172.21.15.149:0/1219423608 learned_addr learned my addr 172.21.15.149:0/1219423608 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.059+0000 7fc95e000640 1 --2- 172.21.15.149:0/1219423608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9600c6a30 0x7fc9600cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600cbf40 con 0x7fc960159060 2024-08-17T02:46:55.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600cb930 con 0x7fc960159430 2024-08-17T02:46:55.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600ced10 con 0x7fc9600c6a30 2024-08-17T02:46:55.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.060+0000 7fc95e000640 1 -- 172.21.15.149:0/1219423608 >> v1:172.21.15.161:6789/0 conn(0x7fc960159430 legacy=0x7fc9600c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f64e5600640 1 -- 172.21.15.149:0/3021118255 shutdown_connections 2024-08-17T02:46:55.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7fd961000640 1 Processor -- start 2024-08-17T02:46:55.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f039f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0398054d00 0x7f03980ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f039f200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e1bd0 0x7f03980f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7fd961000640 1 -- start start 2024-08-17T02:46:55.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f039f200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03980e5c30 0x7f039804e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f039f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980e78b0 con 0x7f0398054d00 2024-08-17T02:46:55.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f039f200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980e7b90 con 0x7f03980e5c30 2024-08-17T02:46:55.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f039f200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980e7e70 con 0x7f03980e1bd0 2024-08-17T02:46:55.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7f64e5600640 1 -- 172.21.15.149:0/3021118255 wait complete. 2024-08-17T02:46:55.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.061+0000 7fc95e000640 1 -- 172.21.15.149:0/1219423608 >> v1:172.21.15.149:6789/0 conn(0x7fc960159060 legacy=0x7fc9600cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7fc95e000640 1 -- 172.21.15.149:0/1219423608 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600cbbd0 con 0x7fc9600c6a30 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f365ca00640 1 Processor -- start 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f365ca00640 1 -- start start 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f039de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0398054d00 0x7f03980ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f039de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0398054d00 0x7f03980ea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48052/0 (socket says 172.21.15.149:48052) 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f039de00640 1 -- 172.21.15.149:0/301909906 learned_addr learned my addr 172.21.15.149:0/301909906 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f039d400640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e1bd0 0x7f03980f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.062+0000 7f039e800640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03980e5c30 0x7f039804e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039de00640 1 -- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e1bd0 msgr2=0x7f03980f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039de00640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e1bd0 0x7f03980f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039de00640 1 -- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03980e5c30 msgr2=0x7f039804e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039de00640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03980e5c30 0x7f039804e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039de00640 1 -- 172.21.15.149:0/301909906 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c009390 con 0x7f0398054d00 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039d400640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03980e1bd0 0x7f03980f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7f039e800640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03980e5c30 0x7f039804e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fc95e000640 1 --2- 172.21.15.149:0/1219423608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9600c6a30 0x7fc9600cb2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009880 tx=0x7fc94c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664726fdf986f094 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fc95d600640 1 -- 172.21.15.149:0/1219423608 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c02ab60 con 0x7fc9600c6a30 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fc95d600640 1 -- 172.21.15.149:0/1219423608 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c02acc0 con 0x7fc9600c6a30 2024-08-17T02:46:55.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fc95d600640 1 -- 172.21.15.149:0/1219423608 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c032670 con 0x7fc9600c6a30 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd961000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd95c0ada10 0x7fd95c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd961000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd95c0b1120 0x7fd95c0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd961000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b36e0 0x7fd95c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd961000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0d0ab0 con 0x7fd95c0b1120 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd961000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0b00c0 con 0x7fd95c0ada10 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd961000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0b0360 con 0x7fd95c0b36e0 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd959e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd95c0ada10 0x7fd95c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd959e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd95c0ada10 0x7fd95c0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36754/0 (socket says 172.21.15.149:36754) 2024-08-17T02:46:55.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.063+0000 7fd959e00640 1 -- 172.21.15.149:0/2387631185 learned_addr learned my addr 172.21.15.149:0/2387631185 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7fd959e00640 1 -- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b36e0 msgr2=0x7fd95c0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f365ca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f365806e7f0 0x7f3658154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f365ca00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 0x7f36580a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f365ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36580abb40 0x7f3658157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f365ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36581377d0 con 0x7f36580abb40 2024-08-17T02:46:55.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f365ca00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36580ac0e0 con 0x7f365806e7f0 2024-08-17T02:46:55.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f365ca00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580ac3c0 con 0x7f365813e730 2024-08-17T02:46:55.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f64e5600640 1 Processor -- start 2024-08-17T02:46:55.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7fd959e00640 1 --2- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b36e0 0x7fd95c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7fd959e00640 1 -- 172.21.15.149:0/2387631185 >> v2:172.21.15.149:3300/0 conn(0x7fd95c0b1120 msgr2=0x7fd95c0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7fd959400640 1 --2- 172.21.15.149:0/2387631185 >> v2:172.21.15.149:3300/0 conn(0x7fd95c0b1120 0x7fd95c0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7fd959e00640 1 --2- 172.21.15.149:0/2387631185 >> v2:172.21.15.149:3300/0 conn(0x7fd95c0b1120 0x7fd95c0b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f64e5600640 1 -- start start 2024-08-17T02:46:55.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7f3656800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36580abb40 0x7f3658157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3655e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f365806e7f0 0x7f3658154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3656800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36580abb40 0x7f3658157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48076/0 (socket says 172.21.15.149:48076) 2024-08-17T02:46:55.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3656800640 1 -- 172.21.15.149:0/3525185113 learned_addr learned my addr 172.21.15.149:0/3525185113 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.064+0000 7fd959e00640 1 -- 172.21.15.149:0/2387631185 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0b0640 con 0x7fd95c0ada10 2024-08-17T02:46:55.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7fd959400640 1 --2- 172.21.15.149:0/2387631185 >> v2:172.21.15.149:3300/0 conn(0x7fd95c0b1120 0x7fd95c0b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9600c6a30 msgr2=0x7fc9600cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7fc965800640 1 --2- 172.21.15.149:0/1219423608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9600c6a30 0x7fc9600cb2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009880 tx=0x7fc94c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3655e00640 1 -- 172.21.15.149:0/3525185113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 msgr2=0x7f36580a9510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:46:55.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3655e00640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f365813e730 0x7f36580a9510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3655e00640 1 -- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36580abb40 msgr2=0x7f3658157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3655e00640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36580abb40 0x7f3658157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f039de00640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0398054d00 0x7f03980ea1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f03a00661b0 tx=0x7f03a006f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f3655e00640 1 -- 172.21.15.149:0/3525185113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3648009450 con 0x7f365806e7f0 2024-08-17T02:46:55.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 shutdown_connections 2024-08-17T02:46:55.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fc965800640 1 --2- 172.21.15.149:0/1219423608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9600c6a30 0x7fc9600cb2d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 >> 172.21.15.149:0/1219423608 conn(0x7fc9600cfde0 msgr2=0x7fc9600d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.065+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a006f470 con 0x7f0398054d00 2024-08-17T02:46:55.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7f3656800640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36580abb40 0x7f3658157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fd959e00640 1 --2- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0ada10 0x7fd95c0b2c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0b5ec0 tx=0x7fd94c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57ac503e84e04c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a008f3b0 con 0x7f0398054d00 2024-08-17T02:46:55.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a008f770 con 0x7f0398054d00 2024-08-17T02:46:55.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fd958a00640 1 -- 172.21.15.149:0/2387631185 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c02add0 con 0x7fd95c0ada10 2024-08-17T02:46:55.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fd958a00640 1 -- 172.21.15.149:0/2387631185 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c032440 con 0x7fd95c0ada10 2024-08-17T02:46:55.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7f3655e00640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f365806e7f0 0x7f3658154630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3648031000 tx=0x7f3648032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648031de0 con 0x7f365806e7f0 2024-08-17T02:46:55.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3648000c40 con 0x7f365806e7f0 2024-08-17T02:46:55.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364803e6a0 con 0x7f365806e7f0 2024-08-17T02:46:55.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03980e8150 con 0x7f0398054d00 2024-08-17T02:46:55.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03980ea6e0 con 0x7f0398054d00 2024-08-17T02:46:55.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 shutdown_connections 2024-08-17T02:46:55.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7fc965800640 1 -- 172.21.15.149:0/1219423608 wait complete. 2024-08-17T02:46:55.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.066+0000 7fd958a00640 1 -- 172.21.15.149:0/2387631185 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c032820 con 0x7fd95c0ada10 2024-08-17T02:46:55.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7fd961000640 1 -- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0ada10 msgr2=0x7fd95c0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7fd961000640 1 --2- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0ada10 0x7fd95c0b2c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0b5ec0 tx=0x7fd94c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7fd961000640 1 -- 172.21.15.149:0/2387631185 shutdown_connections 2024-08-17T02:46:55.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7fd961000640 1 --2- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b36e0 0x7fd95c0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7fd961000640 1 --2- 172.21.15.149:0/2387631185 >> v2:172.21.15.149:3300/0 conn(0x7fd95c0b1120 0x7fd95c0b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7fd961000640 1 --2- 172.21.15.149:0/2387631185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0ada10 0x7fd95c0b2c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7fd961000640 1 -- 172.21.15.149:0/2387631185 >> 172.21.15.149:0/2387631185 conn(0x7fd95c0cfdf0 msgr2=0x7fd95c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36580ac6a0 con 0x7f365806e7f0 2024-08-17T02:46:55.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7f64e5600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64d800c040 0x7f64d80dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3658154b70 con 0x7f365806e7f0 2024-08-17T02:46:55.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7fd961000640 1 -- 172.21.15.149:0/2387631185 shutdown_connections 2024-08-17T02:46:55.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.067+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0398005320 con 0x7f0398054d00 2024-08-17T02:46:55.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.068+0000 7f64e5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d8053020 0x7f64d80d3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64e5600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64d80ddd90 0x7f64d80d3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64dfe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64d800c040 0x7f64d80dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64dfe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64d800c040 0x7f64d80dc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:51000/0 (socket says 172.21.15.149:51000) 2024-08-17T02:46:55.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64dfe00640 1 -- 172.21.15.149:0/3084109210 learned_addr learned my addr 172.21.15.149:0/3084109210 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64e4c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64d80ddd90 0x7f64d80d3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3658064db0 con 0x7f365806e7f0 2024-08-17T02:46:55.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64e5600640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d802d6e0 con 0x7f64d8053020 2024-08-17T02:46:55.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64e5600640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d802cb60 con 0x7f64d80ddd90 2024-08-17T02:46:55.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.069+0000 7f64e5600640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d802ce40 con 0x7f64d800c040 2024-08-17T02:46:55.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.070+0000 7fd961000640 1 -- 172.21.15.149:0/2387631185 wait complete. 2024-08-17T02:46:55.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.070+0000 7f64e4c00640 1 -- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64d800c040 msgr2=0x7f64d80dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.070+0000 7f64df400640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d8053020 0x7f64d80d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64e4c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64d800c040 0x7f64d80dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64e4c00640 1 -- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d8053020 msgr2=0x7f64d80d3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7fd961000640 1 Processor -- start 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64e4c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d8053020 0x7f64d80d3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64e4c00640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e004c200 con 0x7f64d80ddd90 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64df400640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64d8053020 0x7f64d80d3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64dfe00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64d800c040 0x7f64d80dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.071+0000 7f64e4c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64d80ddd90 0x7f64d80d3890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b490 tx=0x7f64d4006f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7fc965800640 1 Processor -- start 2024-08-17T02:46:55.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400f510 con 0x7f64d80ddd90 2024-08-17T02:46:55.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.070+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f03a008fb60 con 0x7f0398054d00 2024-08-17T02:46:55.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7fc965800640 1 -- start start 2024-08-17T02:46:55.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f64e5600640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d802d120 con 0x7f64d80ddd90 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f364803ead0 con 0x7f365806e7f0 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f0395600640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f03800651d0 0x7f0380067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03a00f9000 con 0x7f0398054d00 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7f0395600640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7f038006d3e0 0x7f038006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 --> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f038006fea0 con 0x7f038006d3e0 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a00fb540 con 0x7f0398054d00 2024-08-17T02:46:55.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7f039e800640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7f038006d3e0 0x7f038006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f64e5600640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d80dc910 con 0x7f64d80ddd90 2024-08-17T02:46:55.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400f670 con 0x7f64d80ddd90 2024-08-17T02:46:55.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400f510 con 0x7f64d80ddd90 2024-08-17T02:46:55.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fc965800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9600c6a30 0x7fc96014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fc965800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc960159060 0x7fc960157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fc965800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc960159430 0x7fc96016ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fc965800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c6ed0 con 0x7fc9600c6a30 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fc965800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc960158280 con 0x7fc960159430 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fc965800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b3050 con 0x7fc960159060 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7fc95ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9600c6a30 0x7fc96014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7fd961000640 1 -- start start 2024-08-17T02:46:55.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.072+0000 7f9d66c00640 1 Processor -- start 2024-08-17T02:46:55.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.073+0000 7f9d66c00640 1 -- start start 2024-08-17T02:46:55.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7f1f1c200640 1 Processor -- start 2024-08-17T02:46:55.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7fc95ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9600c6a30 0x7fc96014fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48094/0 (socket says 172.21.15.149:48094) 2024-08-17T02:46:55.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7f039d400640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f03800651d0 0x7f0380067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd961000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd95c0ada10 0x7fd95c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7f1f1c200640 1 -- start start 2024-08-17T02:46:55.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64d8005320 con 0x7f64d80ddd90 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd961000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b1120 0x7fd95c0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd961000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0b36e0 0x7fd95c14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd961000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c09cb40 con 0x7fd95c0ada10 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd961000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c09bcb0 con 0x7fd95c0b36e0 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd961000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c09cfd0 con 0x7fd95c0b1120 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd959400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b1120 0x7fd95c0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd959400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b1120 0x7fd95c0cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:51014/0 (socket says 172.21.15.149:51014) 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd959400640 1 -- 172.21.15.149:0/3851065715 learned_addr learned my addr 172.21.15.149:0/3851065715 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fd95a800640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0b36e0 0x7fd95c14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd959400640 1 -- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0b36e0 msgr2=0x7fd95c14c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd959400640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd95c0b36e0 0x7fd95c14c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7fc95ea00640 1 -- 172.21.15.149:0/1726159168 learned_addr learned my addr 172.21.15.149:0/1726159168 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd959400640 1 -- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd95c0ada10 msgr2=0x7fd95c14a890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:46:55.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd959400640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd95c0ada10 0x7fd95c14a890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7fc95e000640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc960159060 0x7fc960157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd959400640 1 -- 172.21.15.149:0/3851065715 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c009450 con 0x7fd95c0b1120 2024-08-17T02:46:55.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f9d66c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d600ada10 0x7f9d600b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f1c200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f14159430 0x7f1f140cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f1c200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f140cbf40 con 0x7f1f140c6a30 2024-08-17T02:46:55.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f1c200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f140cb930 con 0x7f1f14159060 2024-08-17T02:46:55.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f1c200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140ced10 con 0x7f1f14159430 2024-08-17T02:46:55.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.074+0000 7fc95f400640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc960159430 0x7fc96016ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f364d600640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f36380652a0 0x7f3638067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36480a29c0 con 0x7f365806e7f0 2024-08-17T02:46:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd959400640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b1120 0x7fd95c0cd2c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd94800c880 tx=0x7fd948008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800ce10 con 0x7fd95c0b1120 2024-08-17T02:46:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948007890 con 0x7fd95c0b1120 2024-08-17T02:46:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948007c30 con 0x7fd95c0b1120 2024-08-17T02:46:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c09bf30 con 0x7fd95c0b1120 2024-08-17T02:46:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c09c4f0 con 0x7fd95c0b1120 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fc95e000640 1 -- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc960159430 msgr2=0x7fc96016ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fc95e000640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc960159430 0x7fc96016ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fc95e000640 1 -- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9600c6a30 msgr2=0x7fc96014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fc95e000640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9600c6a30 0x7fc96014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fc95e000640 1 -- 172.21.15.149:0/1726159168 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c009390 con 0x7fc960159060 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7fc95e000640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc960159060 0x7fc960157210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc94c031000 tx=0x7fc94c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c032b30 con 0x7fc960159060 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c032cb0 con 0x7fc960159060 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c04b670 con 0x7fc960159060 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600b2d20 con 0x7fc960159060 2024-08-17T02:46:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc95ea00640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9600c6a30 0x7fc96014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc960157fa0 con 0x7fc960159060 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.076+0000 7fc95f400640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc960159430 0x7fc96016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f19800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1f14159060 0x7f1f140cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35512/0 (socket says 172.21.15.149:35512) 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f364d600640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7f363806d4b0 0x7f363806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 --> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f363806ff70 con 0x7f363806d4b0 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36480a2cf0 con 0x7f365806e7f0 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f3655400640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f36380652a0 0x7f3638067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f3656800640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7f363806d4b0 0x7f363806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.075+0000 7f039e800640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7f038006d3e0 0x7f038006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== osd.1 v2:172.21.15.149:6816/37225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f038006fea0 con 0x7f038006d3e0 2024-08-17T02:46:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f9d66c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600d0ab0 con 0x7f9d600b38b0 2024-08-17T02:46:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f9d66c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600b00c0 con 0x7f9d600b1120 2024-08-17T02:46:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f9d66c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600b0360 con 0x7f9d600ada10 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f9d5fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d600ada10 0x7f9d600b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f9d5fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d600ada10 0x7f9d600b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36802/0 (socket says 172.21.15.149:36802) 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f9d5fe00640 1 -- 172.21.15.149:0/641140652 learned_addr learned my addr 172.21.15.149:0/641140652 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f19800640 1 -- 172.21.15.149:0/1737962286 learned_addr learned my addr 172.21.15.149:0/1737962286 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.077+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1737962286 >> v2:172.21.15.161:3300/0 conn(0x7f1f14159430 0x7f1f140cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493564236 0 0) 0x7f1f140cb930 con 0x7f1f14159060 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1efc0034e0 con 0x7f1f14159060 2024-08-17T02:46:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008776709 0 0) 0x7f1f140cbf40 con 0x7f1f140c6a30 2024-08-17T02:46:55.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362566173 0 0) 0x7f9d600b00c0 con 0x7f9d600b1120 2024-08-17T02:46:55.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d400034e0 con 0x7f9d600b1120 2024-08-17T02:46:55.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f140cb930 con 0x7f1f140c6a30 2024-08-17T02:46:55.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227695996 0 0) 0x7f1efc0034e0 con 0x7f1f14159060 2024-08-17T02:46:55.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 >> v2:172.21.15.161:3300/0 conn(0x7f1f14159430 msgr2=0x7f1f140cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 --2- 172.21.15.149:0/1737962286 >> v2:172.21.15.161:3300/0 conn(0x7f1f14159430 0x7f1f140cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 >> v1:172.21.15.149:6789/0 conn(0x7f1f140c6a30 legacy=0x7f1f140c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140cbbd0 con 0x7f1f14159060 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f1f08001470 con 0x7f1f14159060 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27712625 0 0) 0x7f9d600d0ab0 con 0x7f9d600b38b0 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d600b00c0 con 0x7f9d600b38b0 2024-08-17T02:46:55.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f039d400640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f03800651d0 0x7f0380067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0398059790 tx=0x7f0390009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3492053810 0 0) 0x7f9d400034e0 con 0x7f9d600b1120 2024-08-17T02:46:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 >> v2:172.21.15.161:3300/0 conn(0x7f9d600ada10 msgr2=0x7f9d600b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/641140652 >> v2:172.21.15.161:3300/0 conn(0x7f9d600ada10 0x7f9d600b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 >> v1:172.21.15.161:6789/0 conn(0x7f1f14159060 legacy=0x7f1f140cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1efc003b60 0x7f1efc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.078+0000 7f1f13e00640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1efc004780 0x7f1efc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f1f13e00640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1efc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140ced10 con 0x7f1efc005130 2024-08-17T02:46:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc00c050 con 0x7f1efc004780 2024-08-17T02:46:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc014a20 con 0x7f1efc003b60 2024-08-17T02:46:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f1f19800640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1efc003b60 0x7f1efc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f3656800640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7f363806d4b0 0x7f363806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc960157fa0 con 0x7fc960159060 2024-08-17T02:46:55.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f1f18e00640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1efc004780 0x7f1efc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 >> v1:172.21.15.149:6789/0 conn(0x7f9d600b38b0 legacy=0x7f9d600aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600b0640 con 0x7f9d600b1120 2024-08-17T02:46:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f9d48001470 con 0x7f9d600b1120 2024-08-17T02:46:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7fc642a00640 1 Processor -- start 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 >> v1:172.21.15.161:6789/0 conn(0x7f9d600b1120 legacy=0x7f9d600b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d40003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d40004780 0x7f9d40004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d400051a0 0x7f9d400141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600b0360 con 0x7f9d40004780 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400148e0 con 0x7f9d400051a0 2024-08-17T02:46:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1efc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40014aa0 con 0x7f9d40003b60 2024-08-17T02:46:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d40003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd95c064db0 con 0x7fd95c0b1120 2024-08-17T02:46:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.079+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f64d400fab0 con 0x7f64d80ddd90 2024-08-17T02:46:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f64d3400640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f64c0069650 0x7f64c006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64d4081b10 con 0x7f64d80ddd90 2024-08-17T02:46:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f64d3400640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f64c0071860 0x7f64c0073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64c0074320 con 0x7f64c0071860 2024-08-17T02:46:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64d4086220 con 0x7f64d80ddd90 2024-08-17T02:46:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9480113f0 con 0x7fd95c0b1120 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f9d5fe00640 1 -- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d400051a0 msgr2=0x7f9d400141e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d400051a0 0x7f9d400141e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f9d5fe00640 1 -- 172.21.15.149:0/641140652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d40004780 msgr2=0x7f9d40004bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d40004780 0x7f9d40004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f9d5fe00640 1 -- 172.21.15.149:0/641140652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600b0640 con 0x7f9d40003b60 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7f9d64c00640 1 -- 172.21.15.149:0/641140652 reap_dead start 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f1a200640 1 -- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1efc003b60 msgr2=0x7f1efc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1efc003b60 0x7f1efc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f1a200640 1 -- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1efc004780 msgr2=0x7f1efc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1efc004780 0x7f1efc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f1a200640 1 -- 172.21.15.149:0/1737962286 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140cbbd0 con 0x7f1efc005130 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f1f19800640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1efc003b60 0x7f1efc003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.081+0000 7f1f1a200640 1 -- 172.21.15.149:0/1737962286 reap_dead start 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1efc00b9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007440 tx=0x7f1f0c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55ddbac148ddea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7fc642a00640 1 -- start start 2024-08-17T02:46:55.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c02e430 con 0x7f1efc005130 2024-08-17T02:46:55.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d40003f50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009dc0 tx=0x7f9d580091c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df8c8f7e0c12abdd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c02e590 con 0x7f1efc005130 2024-08-17T02:46:55.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc94c049070 con 0x7fc960159060 2024-08-17T02:46:55.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7fc642a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc63c0b1440 0x7fc63c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7fc642a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c0caa80 con 0x7fc63c1401b0 2024-08-17T02:46:55.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7fc642a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c0c9e70 con 0x7fc63c140580 2024-08-17T02:46:55.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7fc642a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0cb450 con 0x7fc63c0b1440 2024-08-17T02:46:55.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.082+0000 7f1f13e00640 1 -- 172.21.15.149:0/1737962286 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c02e910 con 0x7f1efc005130 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58033410 con 0x7f9d40003b60 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5802d030 con 0x7f9d40003b60 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f9d5ea00640 1 -- 172.21.15.149:0/641140652 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d580337e0 con 0x7f9d40003b60 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.080+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== osd.0 v2:172.21.15.149:6800/37223 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f363806ff70 con 0x7f363806d4b0 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7fc640a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc63c140580 0x7fc63c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35518/0 (socket says 172.21.15.149:35518) 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7fc640a00640 1 -- 172.21.15.149:0/3541944617 learned_addr learned my addr 172.21.15.149:0/3541944617 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f1f1c200640 1 -- 172.21.15.149:0/1737962286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 msgr2=0x7f1efc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f3655400640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f36380652a0 0x7f3638067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f365806da60 tx=0x7f36440090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f64dfe00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f64c0069650 0x7f64c006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f1f1c200640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1efc00b9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007440 tx=0x7f1f0c009710 comp rx=0 tx=0).stop 2024-08-17T02:46:55.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f1f1c200640 1 -- 172.21.15.149:0/1737962286 shutdown_connections 2024-08-17T02:46:55.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f1f1c200640 1 --2- 172.21.15.149:0/1737962286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1efc00b9d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7f1f1c200640 1 -- 172.21.15.149:0/1737962286 >> 172.21.15.149:0/1737962286 conn(0x7f1f140cfde0 msgr2=0x7f1f140d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43997743 0 0) 0x7fc63c0c9e70 con 0x7fc63c140580 2024-08-17T02:46:55.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.083+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6200034e0 con 0x7fc63c140580 2024-08-17T02:46:55.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc956000640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9400652d0 0x7fc940067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc94c0aac30 con 0x7fc960159060 2024-08-17T02:46:55.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fd951600640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd93c0652a0 0x7fd93c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc95ea00640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9400652d0 0x7fc940067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088001079 0 0) 0x7fc6200034e0 con 0x7fc63c140580 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 >> v2:172.21.15.161:3300/0 conn(0x7fc63c0b1440 msgr2=0x7fc63c0caf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc63aa00640 1 --2- 172.21.15.149:0/3541944617 >> v2:172.21.15.161:3300/0 conn(0x7fc63c0b1440 0x7fc63c0caf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 >> v1:172.21.15.149:6789/0 conn(0x7fc63c1401b0 legacy=0x7fc63c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0b0b40 con 0x7fc63c140580 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc956000640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc94006d460 0x7fc94006f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7f9d66c00640 1 -- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 msgr2=0x7f9d40003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7f9d66c00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d40003f50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009dc0 tx=0x7f9d580091c0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 --> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc94006ff20 con 0x7fc94006d460 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.084+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc94c078d00 con 0x7fc960159060 2024-08-17T02:46:55.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd948082480 con 0x7fd95c0b1120 2024-08-17T02:46:55.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fd959e00640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd93c0652a0 0x7fd93c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc95f400640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc94006d460 0x7fc94006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fd951600640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fd93c06d4b0 0x7fd93c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc95ea00640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9400652d0 0x7fc940067780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc950007fd0 tx=0x7fc950009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 --> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd93c06ff70 con 0x7fd93c06d4b0 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd948084a20 con 0x7fd95c0b1120 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7f9d66c00640 1 -- 172.21.15.149:0/641140652 shutdown_connections 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7f9d66c00640 1 --2- 172.21.15.149:0/641140652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d40003f50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7f9d66c00640 1 -- 172.21.15.149:0/641140652 >> 172.21.15.149:0/641140652 conn(0x7f9d600cfdf0 msgr2=0x7f9d600d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7fc634001470 con 0x7fc63c140580 2024-08-17T02:46:55.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 >> v1:172.21.15.161:6789/0 conn(0x7fc63c140580 legacy=0x7fc63c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63aa00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620003aa0 0x7fc620003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63aa00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc620004780 0x7fc620004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63aa00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc620005380 0x7fc62000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0cb450 con 0x7fc620005380 2024-08-17T02:46:55.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63be00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620003aa0 0x7fc620003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7f1f1c200640 1 -- 172.21.15.149:0/1737962286 shutdown_connections 2024-08-17T02:46:55.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7fc63b400640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc620004780 0x7fc620004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7f1f1c200640 1 -- 172.21.15.149:0/1737962286 wait complete. 2024-08-17T02:46:55.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7f9d66c00640 1 -- 172.21.15.149:0/641140652 shutdown_connections 2024-08-17T02:46:55.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7fd95a800640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fd93c06d4b0 0x7fd93c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620014a80 con 0x7fc620003aa0 2024-08-17T02:46:55.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7f9d66c00640 1 -- 172.21.15.149:0/641140652 wait complete. 2024-08-17T02:46:55.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7f64dfe00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f64c0069650 0x7f64c006bb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64e0076e00 tx=0x7f64e00a9000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.085+0000 7f64df400640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f64c0071860 0x7f64c0073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7f64df400640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f64c0071860 0x7f64c0073c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7fc95f400640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc94006d460 0x7fc94006f870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc620014c40 con 0x7fc620004780 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.086+0000 7fc640a00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc620005380 0x7fc62000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fc640a00640 1 -- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc620004780 msgr2=0x7fc620004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fc640a00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc620004780 0x7fc620004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fc640a00640 1 -- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620003aa0 msgr2=0x7fc620003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fc640a00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620003aa0 0x7fc620003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fc640a00640 1 -- 172.21.15.149:0/3541944617 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200034e0 con 0x7fc620005380 2024-08-17T02:46:55.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fd959e00640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd93c0652a0 0x7fd93c067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd94c034000 tx=0x7fd94c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.087+0000 7fc63b400640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc620004780 0x7fc620004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.088+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== osd.3 v2:172.21.15.149:6808/37222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc94006ff20 con 0x7fc94006d460 2024-08-17T02:46:55.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.088+0000 7f1f1c200640 1 Processor -- start 2024-08-17T02:46:55.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.088+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== osd.2 v2:172.21.15.149:6821/37224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f64c0074320 con 0x7f64c0071860 2024-08-17T02:46:55.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.088+0000 7fd95a800640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fd93c06d4b0 0x7fd93c06f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.088+0000 7f1f1c200640 1 -- start start 2024-08-17T02:46:55.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.088+0000 7fc640a00640 1 -- 172.21.15.149:0/3541944617 reap_dead start 2024-08-17T02:46:55.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7f1f1c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1f14152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7f1f1c200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f1414ce50 0x7f1f14157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7f1f1c200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f140b3620 0x7f1f140b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7f1f1c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140b3fd0 con 0x7f1efc005130 2024-08-17T02:46:55.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7f1f1c200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c72e0 con 0x7f1f140b3620 2024-08-17T02:46:55.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7f1f1c200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141528c0 con 0x7f1f1414ce50 2024-08-17T02:46:55.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7fc640a00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc620005380 0x7fc62000ba30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c210 tx=0x7fc634001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf16cb5906a8b7a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.089+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== osd.4 v2:172.21.15.161:6819/37094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd93c06ff70 con 0x7fd93c06d4b0 2024-08-17T02:46:55.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f9d66c00640 1 Processor -- start 2024-08-17T02:46:55.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f1f19800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1f14152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f1f19800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1f14152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48130/0 (socket says 172.21.15.149:48130) 2024-08-17T02:46:55.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f1f19800640 1 -- 172.21.15.149:0/1164396886 learned_addr learned my addr 172.21.15.149:0/1164396886 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f1f18e00640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f1414ce50 0x7f1f14157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f9d66c00640 1 -- start start 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f9d66c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d60164e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f9d66c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d6015bec0 0x7f9d6014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f9d66c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d601653b0 0x7f9d6009c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f9d66c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60165e40 con 0x7f9d601653b0 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f9d66c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015a5b0 con 0x7f9d6015bec0 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f9d66c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60165880 con 0x7f9d40003b60 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.092+0000 7f9d64c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d601653b0 0x7f9d6009c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.092+0000 7f9d64c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d601653b0 0x7f9d6009c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48132/0 (socket says 172.21.15.149:48132) 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.092+0000 7f9d64c00640 1 -- 172.21.15.149:0/844308425 learned_addr learned my addr 172.21.15.149:0/844308425 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.092+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d60164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.092+0000 7f9d5f400640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d6015bec0 0x7f9d6014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.090+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f140b3620 0x7f1f140b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f1f19800640 1 -- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f1414ce50 msgr2=0x7f1f14157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f1f19800640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f1414ce50 0x7f1f14157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f1f19800640 1 -- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f140b3620 msgr2=0x7f1f140b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f1f19800640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f140b3620 0x7f1f140b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.091+0000 7f1f19800640 1 -- 172.21.15.149:0/1164396886 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f14152ba0 con 0x7f1efc005130 2024-08-17T02:46:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.092+0000 7f1f19800640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1f14152290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800dc00 tx=0x7f1f08009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634005890 con 0x7fc620005380 2024-08-17T02:46:55.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08007430 con 0x7f1efc005130 2024-08-17T02:46:55.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7fc63aa00640 1 -- 172.21.15.149:0/3541944617 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63402d070 con 0x7fc620005380 2024-08-17T02:46:55.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08007590 con 0x7f1efc005130 2024-08-17T02:46:55.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f080049f0 con 0x7f1efc005130 2024-08-17T02:46:55.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f9d64c00640 1 -- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 msgr2=0x7f9d60164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f9d64c00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d40003b60 0x7f9d60164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f9d64c00640 1 -- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d6015bec0 msgr2=0x7f9d6014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f9d64c00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d6015bec0 0x7f9d6014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f9d64c00640 1 -- 172.21.15.149:0/844308425 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60165b60 con 0x7f9d601653b0 2024-08-17T02:46:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f14152e80 con 0x7f1efc005130 2024-08-17T02:46:55.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.093+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f141583f0 con 0x7f1efc005130 2024-08-17T02:46:55.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.094+0000 7fc642a00640 1 -- 172.21.15.149:0/3541944617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc620005380 msgr2=0x7fc62000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.094+0000 7fc642a00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc620005380 0x7fc62000ba30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c210 tx=0x7fc634001dc0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.095+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f14063d20 con 0x7f1efc005130 2024-08-17T02:46:55.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.095+0000 7fc642a00640 1 -- 172.21.15.149:0/3541944617 shutdown_connections 2024-08-17T02:46:55.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.095+0000 7fc642a00640 1 --2- 172.21.15.149:0/3541944617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc620005380 0x7fc62000ba30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.095+0000 7fc642a00640 1 -- 172.21.15.149:0/3541944617 >> 172.21.15.149:0/3541944617 conn(0x7fc63c0cb9b0 msgr2=0x7fc63c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.096+0000 7f9d64c00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d601653b0 0x7f9d6009c500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d60088f60 tx=0x7f9d50007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.096+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500072e0 con 0x7f9d601653b0 2024-08-17T02:46:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.096+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50007440 con 0x7f9d601653b0 2024-08-17T02:46:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.096+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000cae0 con 0x7f9d601653b0 2024-08-17T02:46:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.097+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6015a850 con 0x7f9d601653b0 2024-08-17T02:46:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.097+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6014d760 con 0x7f9d601653b0 2024-08-17T02:46:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.095+0000 7fc642a00640 1 -- 172.21.15.149:0/3541944617 shutdown_connections 2024-08-17T02:46:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.095+0000 7fc642a00640 1 -- 172.21.15.149:0/3541944617 wait complete. 2024-08-17T02:46:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.097+0000 7fc642a00640 1 Processor -- start 2024-08-17T02:46:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.098+0000 7fc642a00640 1 -- start start 2024-08-17T02:46:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.096+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1f0800b700 con 0x7f1efc005130 2024-08-17T02:46:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.098+0000 7f1f10c00640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ef4065200 0x7f1ef40676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.098+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f08082170 con 0x7f1efc005130 2024-08-17T02:46:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.098+0000 7f1f10c00640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7f1ef406d390 0x7f1ef406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.098+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 --> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ef406fe50 con 0x7f1ef406d390 2024-08-17T02:46:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.099+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f08007700 con 0x7f1efc005130 2024-08-17T02:46:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.099+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7f1ef406d390 0x7f1ef406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.100+0000 7fc642a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620005380 0x7fc63c156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.100+0000 7f1f1a200640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7f1ef406d390 0x7f1ef406f7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.101+0000 7f1f18e00640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ef4065200 0x7f1ef40676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.101+0000 7fc642a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc63c156670 0x7fc63c167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.101+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== osd.6 v2:172.21.15.161:6800/37092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1ef406fe50 con 0x7f1ef406d390 2024-08-17T02:46:55.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.102+0000 7f1f18e00640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ef4065200 0x7f1ef40676b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f140b33e0 tx=0x7f1f00007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.101+0000 7fc63be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620005380 0x7fc63c156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc642a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c168220 0x7fc63c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc642a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1647d0 con 0x7fc63c168220 2024-08-17T02:46:55.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc642a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c168730 con 0x7fc620005380 2024-08-17T02:46:55.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.102+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d50005780 con 0x7f9d601653b0 2024-08-17T02:46:55.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.102+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d60064db0 con 0x7f9d601653b0 2024-08-17T02:46:55.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7f9d57400640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc642a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c168a10 con 0x7fc63c156670 2024-08-17T02:46:55.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.103+0000 7fc63b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc63c156670 0x7fc63c167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc63b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc63c156670 0x7fc63c167ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:51060/0 (socket says 172.21.15.149:51060) 2024-08-17T02:46:55.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc63b400640 1 -- 172.21.15.149:0/2033181797 learned_addr learned my addr 172.21.15.149:0/2033181797 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d50052b90 con 0x7f9d601653b0 2024-08-17T02:46:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7f9d57400640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f9d3c06df70 0x7f9d3c070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 --> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d3c070ad0 con 0x7f9d3c06df70 2024-08-17T02:46:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7f9d5f400640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f9d3c06df70 0x7f9d3c070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d58035000 tx=0x7f9d58038000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 --> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0398006920 con 0x7f038006d3e0 2024-08-17T02:46:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.107+0000 7f0395600640 1 -- 172.21.15.149:0/301909906 <== osd.1 v2:172.21.15.149:6816/37225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0398006920 con 0x7f038006d3e0 2024-08-17T02:46:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.107+0000 7f9d5f400640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f9d3c06df70 0x7f9d3c070400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc640a00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c168220 0x7fc63c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc63b400640 1 -- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620005380 msgr2=0x7fc63c156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.104+0000 7fc63b400640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620005380 0x7fc63c156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7fc63b400640 1 -- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c168220 msgr2=0x7fc63c0a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7fc63b400640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c168220 0x7fc63c0a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7fc63b400640 1 -- 172.21.15.149:0/2033181797 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c164a20 con 0x7fc63c156670 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.105+0000 7fc63b400640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc63c156670 0x7fc63c167ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e970 tx=0x7fc628000f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800c940 con 0x7fc63c156670 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800caa0 con 0x7fc63c156670 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800ce40 con 0x7fc63c156670 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7fc63be00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc620005380 0x7fc63c156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c164d00 con 0x7fc63c156670 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.106+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0a5a10 con 0x7fc63c156670 2024-08-17T02:46:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.107+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7f038006d3e0 msgr2=0x7f038006f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f039f200640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7f038006d3e0 0x7f038006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== osd.5 v2:172.21.15.161:6808/37093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9d3c070ad0 con 0x7f9d3c06df70 2024-08-17T02:46:55.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f03800651d0 msgr2=0x7f0380067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f039f200640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f03800651d0 0x7f0380067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0398059790 tx=0x7f0390009040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0398054d00 msgr2=0x7f03980ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f039f200640 1 --2- 172.21.15.149:0/301909906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0398054d00 0x7f03980ea1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f03a00661b0 tx=0x7f03a006f710 comp rx=0 tx=0).stop 2024-08-17T02:46:55.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f039e800640 1 -- 172.21.15.149:0/301909906 reap_dead start 2024-08-17T02:46:55.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d50052960 con 0x7f9d601653b0 2024-08-17T02:46:55.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.109+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 shutdown_connections 2024-08-17T02:46:55.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.109+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 >> 172.21.15.149:0/301909906 conn(0x7f039800f070 msgr2=0x7f03980e0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.109+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 shutdown_connections 2024-08-17T02:46:55.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.109+0000 7f039f200640 1 -- 172.21.15.149:0/301909906 wait complete. 2024-08-17T02:46:55.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.108+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc614000fd0 con 0x7fc63c156670 2024-08-17T02:46:55.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.110+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc628012600 con 0x7fc63c156670 2024-08-17T02:46:55.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.111+0000 7fc633400640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc61c065250 0x7fc61c067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.111+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc62800e010 con 0x7fc63c156670 2024-08-17T02:46:55.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.111+0000 7fc63be00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc61c065250 0x7fc61c067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.112+0000 7fc633400640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fc61c06e070 0x7fc61c070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.112+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 --> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc61c070bd0 con 0x7fc61c06e070 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.112+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc628053f10 con 0x7fc63c156670 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.113+0000 7fc640a00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fc61c06e070 0x7fc61c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.113+0000 7fc63be00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc61c065250 0x7fc61c067700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc62c003fc0 tx=0x7fc62c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.113+0000 7fc640a00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fc61c06e070 0x7fc61c070500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.115+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== osd.7 v2:172.21.15.161:6816/37102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc61c070bd0 con 0x7fc61c06e070 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.117+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 --> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64d8052e00 con 0x7f64c0071860 2024-08-17T02:46:55.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.118+0000 7f64d3400640 1 -- 172.21.15.149:0/3084109210 <== osd.2 v2:172.21.15.149:6821/37224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64d8052e00 con 0x7f64c0071860 2024-08-17T02:46:55.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.118+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 --> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f365806ad20 con 0x7f363806d4b0 2024-08-17T02:46:55.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f64c0071860 msgr2=0x7f64c0073c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f364d600640 1 -- 172.21.15.149:0/3525185113 <== osd.0 v2:172.21.15.149:6800/37223 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f365806ad20 con 0x7f363806d4b0 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f64c0071860 0x7f64c0073c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f64c0069650 msgr2=0x7f64c006bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f64c0069650 0x7f64c006bb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64e0076e00 tx=0x7f64e00a9000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64d80ddd90 msgr2=0x7f64d80d3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 --2- 172.21.15.149:0/3084109210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64d80ddd90 0x7f64d80d3890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b490 tx=0x7f64d4006f50 comp rx=0 tx=0).stop 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64e4c00640 1 -- 172.21.15.149:0/3084109210 reap_dead start 2024-08-17T02:46:55.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 shutdown_connections 2024-08-17T02:46:55.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 >> 172.21.15.149:0/3084109210 conn(0x7f64d8009fa0 msgr2=0x7f64d80369e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.119+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 shutdown_connections 2024-08-17T02:46:55.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.120+0000 7f64d0c00640 1 -- 172.21.15.149:0/3084109210 wait complete. 2024-08-17T02:46:55.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.122+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 --> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc960063d20 con 0x7fc94006d460 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.122+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7f363806d4b0 msgr2=0x7f363806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.122+0000 7f365ca00640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7f363806d4b0 0x7f363806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.123+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f36380652a0 msgr2=0x7f3638067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.123+0000 7f365ca00640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f36380652a0 0x7f3638067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f365806da60 tx=0x7f36440090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.123+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f365806e7f0 msgr2=0x7f3658154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.123+0000 7f365ca00640 1 --2- 172.21.15.149:0/3525185113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f365806e7f0 0x7f3658154630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3648031000 tx=0x7f3648032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.123+0000 7f3656800640 1 -- 172.21.15.149:0/3525185113 reap_dead start 2024-08-17T02:46:55.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.123+0000 7fc956000640 1 -- 172.21.15.149:0/1726159168 <== osd.3 v2:172.21.15.149:6808/37222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc960063d20 con 0x7fc94006d460 2024-08-17T02:46:55.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.124+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc94006d460 msgr2=0x7fc94006f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.124+0000 7fc965800640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc94006d460 0x7fc94006f870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.124+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 shutdown_connections 2024-08-17T02:46:55.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.124+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 >> 172.21.15.149:0/3525185113 conn(0x7f36580cc480 msgr2=0x7f365813a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 shutdown_connections 2024-08-17T02:46:55.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7f365ca00640 1 -- 172.21.15.149:0/3525185113 wait complete. 2024-08-17T02:46:55.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9400652d0 msgr2=0x7fc940067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9400652d0 0x7fc940067780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc950007fd0 tx=0x7fc950009040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc960159060 msgr2=0x7fc960157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 --2- 172.21.15.149:0/1726159168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc960159060 0x7fc960157210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc94c031000 tx=0x7fc94c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc95f400640 1 -- 172.21.15.149:0/1726159168 reap_dead start 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 shutdown_connections 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 >> 172.21.15.149:0/1726159168 conn(0x7fc9600cfde0 msgr2=0x7fc960067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.126+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 shutdown_connections 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.127+0000 7fc965800640 1 -- 172.21.15.149:0/1726159168 wait complete. 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.128+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 --> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d60070430 con 0x7f9d3c06df70 2024-08-17T02:46:55.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.129+0000 7f9d57400640 1 -- 172.21.15.149:0/844308425 <== osd.5 v2:172.21.15.161:6808/37093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d60070430 con 0x7f9d3c06df70 2024-08-17T02:46:55.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.129+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 --> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f140cc5f0 con 0x7f1ef406d390 2024-08-17T02:46:55.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.130+0000 7f1f10c00640 1 -- 172.21.15.149:0/1164396886 <== osd.6 v2:172.21.15.161:6800/37092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f140cc5f0 con 0x7f1ef406d390 2024-08-17T02:46:55.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.130+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f9d3c06df70 msgr2=0x7f9d3c070400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.130+0000 7f9d66c00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f9d3c06df70 0x7f9d3c070400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.130+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7f1ef406d390 msgr2=0x7f1ef406f7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.130+0000 7f1f1c200640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7f1ef406d390 0x7f1ef406f7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ef4065200 msgr2=0x7f1ef40676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ef4065200 0x7f1ef40676b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f140b33e0 tx=0x7f1f00007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 msgr2=0x7f9d3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d66c00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d58035000 tx=0x7f9d58038000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d601653b0 msgr2=0x7f9d6009c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d66c00640 1 --2- 172.21.15.149:0/844308425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d601653b0 0x7f9d6009c500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d60088f60 tx=0x7f9d50007c80 comp rx=0 tx=0).stop 2024-08-17T02:46:55.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 msgr2=0x7f1f14152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 --2- 172.21.15.149:0/1164396886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1efc005130 0x7f1f14152290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800dc00 tx=0x7f1f08009040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d64c00640 1 -- 172.21.15.149:0/844308425 reap_dead start 2024-08-17T02:46:55.179 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1a200640 1 -- 172.21.15.149:0/1164396886 reap_dead start 2024-08-17T02:46:55.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 shutdown_connections 2024-08-17T02:46:55.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 >> 172.21.15.149:0/1164396886 conn(0x7f1f140cfde0 msgr2=0x7f1f140cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 shutdown_connections 2024-08-17T02:46:55.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 >> 172.21.15.149:0/844308425 conn(0x7f9d600cfdf0 msgr2=0x7f9d60067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 --> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd95c0008d0 con 0x7fd93c06d4b0 2024-08-17T02:46:55.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 shutdown_connections 2024-08-17T02:46:55.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.131+0000 7f1f1c200640 1 -- 172.21.15.149:0/1164396886 wait complete. 2024-08-17T02:46:55.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.132+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 shutdown_connections 2024-08-17T02:46:55.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.132+0000 7f9d66c00640 1 -- 172.21.15.149:0/844308425 wait complete. 2024-08-17T02:46:55.182 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.132+0000 7fd951600640 1 -- 172.21.15.149:0/3851065715 <== osd.4 v2:172.21.15.161:6819/37094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd95c0008d0 con 0x7fd93c06d4b0 2024-08-17T02:46:55.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.133+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fd93c06d4b0 msgr2=0x7fd93c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.133+0000 7fd961000640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fd93c06d4b0 0x7fd93c06f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.134+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd93c0652a0 msgr2=0x7fd93c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.134+0000 7fd961000640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd93c0652a0 0x7fd93c067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd94c034000 tx=0x7fd94c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.134+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b1120 msgr2=0x7fd95c0cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.183 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.134+0000 7fd961000640 1 --2- 172.21.15.149:0/3851065715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd95c0b1120 0x7fd95c0cd2c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd94800c880 tx=0x7fd948008040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.135+0000 7fd95a800640 1 -- 172.21.15.149:0/3851065715 reap_dead start 2024-08-17T02:46:55.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.135+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 shutdown_connections 2024-08-17T02:46:55.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.135+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 >> 172.21.15.149:0/3851065715 conn(0x7fd95c0cfdf0 msgr2=0x7fd95c068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.136+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 shutdown_connections 2024-08-17T02:46:55.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.136+0000 7fd961000640 1 -- 172.21.15.149:0/3851065715 wait complete. 2024-08-17T02:46:55.185 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:55.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:46:55.185 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.142+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 --> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc614002ca0 con 0x7fc61c06e070 2024-08-17T02:46:55.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.143+0000 7fc633400640 1 -- 172.21.15.149:0/2033181797 <== osd.7 v2:172.21.15.161:6816/37102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc614002ca0 con 0x7fc61c06e070 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.144+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fc61c06e070 msgr2=0x7fc61c070500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.144+0000 7fc642a00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fc61c06e070 0x7fc61c070500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.144+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc61c065250 msgr2=0x7fc61c067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.144+0000 7fc642a00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc61c065250 0x7fc61c067700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc62c003fc0 tx=0x7fc62c009040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.144+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc63c156670 msgr2=0x7fc63c167ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.144+0000 7fc642a00640 1 --2- 172.21.15.149:0/2033181797 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc63c156670 0x7fc63c167ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e970 tx=0x7fc628000f90 comp rx=0 tx=0).stop 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.145+0000 7fc640a00640 1 -- 172.21.15.149:0/2033181797 reap_dead start 2024-08-17T02:46:55.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.145+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 shutdown_connections 2024-08-17T02:46:55.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.145+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 >> 172.21.15.149:0/2033181797 conn(0x7fc63c0cb9b0 msgr2=0x7fc63c06c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.145+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 shutdown_connections 2024-08-17T02:46:55.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.145+0000 7fc642a00640 1 -- 172.21.15.149:0/2033181797 wait complete. 2024-08-17T02:46:55.188 INFO:teuthology.orchestra.run.smithi149.stdout:64424509446 2024-08-17T02:46:55.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:46:55.190 INFO:teuthology.orchestra.run.smithi149.stdout:60129542152 2024-08-17T02:46:55.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:46:55.191 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:55.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:46:55.193 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:55.193 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:46:55.195 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:55.195 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:46:55.196 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:55.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:46:55.197 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:55.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:46:55.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.490+0000 7f3e7e000640 1 Processor -- start 2024-08-17T02:46:55.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.490+0000 7f41f3600640 1 Processor -- start 2024-08-17T02:46:55.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.490+0000 7f3e7e000640 1 -- start start 2024-08-17T02:46:55.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.492+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e70006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.492+0000 7f3e7e000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 0x7f3e700e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.492+0000 7f3e7e000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e70006c10 con 0x7f3e700e1bd0 2024-08-17T02:46:55.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.492+0000 7f3e7e000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e70006ef0 con 0x7f3e70006690 2024-08-17T02:46:55.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.492+0000 7f3e7e000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700071d0 con 0x7f3e70054d00 2024-08-17T02:46:55.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.491+0000 7f41f3600640 1 -- start start 2024-08-17T02:46:55.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.493+0000 7f41f3600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41e40071b0 0x7f41e4051590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.493+0000 7f41f3600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e4051100 con 0x7f41e40093b0 2024-08-17T02:46:55.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.493+0000 7f41f3600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e40504f0 con 0x7f41e40e0860 2024-08-17T02:46:55.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.493+0000 7f41f3600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e40502e0 con 0x7f41e40071b0 2024-08-17T02:46:55.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.493+0000 7f3e7d600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 0x7f3e700e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f3e7d600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 0x7f3e700e5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36870/0 (socket says 172.21.15.149:36870) 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f3e7d600640 1 -- 172.21.15.149:0/804436094 learned_addr learned my addr 172.21.15.149:0/804436094 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f3e77e00640 1 --2- 172.21.15.149:0/804436094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e70006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f41f1600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41e40071b0 0x7f41e4051590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f41f0c00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f41e40e0860 0x7f41e4008ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35534/0 (socket says 172.21.15.149:35534) 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f41f0c00640 1 -- 172.21.15.149:0/3273264939 learned_addr learned my addr 172.21.15.149:0/3273264939 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.494+0000 7f41ebe00640 1 --1- 172.21.15.149:0/3273264939 >> v1:172.21.15.149:6789/0 conn(0x7f41e40093b0 0x7f41e4006aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35622/0 (socket says 172.21.15.149:35622) 2024-08-17T02:46:55.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f3e77e00640 1 -- 172.21.15.149:0/804436094 >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 msgr2=0x7f3e700e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f3e77e00640 1 --2- 172.21.15.149:0/804436094 >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 0x7f3e700e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870278345 0 0) 0x7f41e4051100 con 0x7f41e40093b0 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d40034e0 con 0x7f41e40093b0 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333659501 0 0) 0x7f41e40504f0 con 0x7f41e40e0860 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e4051100 con 0x7f41e40e0860 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2603516265 0 0) 0x7f41d40034e0 con 0x7f41e40093b0 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 >> v2:172.21.15.161:3300/0 conn(0x7f41e40071b0 msgr2=0x7f41e4051590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 --2- 172.21.15.149:0/3273264939 >> v2:172.21.15.161:3300/0 conn(0x7f41e40071b0 0x7f41e4051590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 >> v1:172.21.15.161:6789/0 conn(0x7f41e40e0860 legacy=0x7f41e4008ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e40507d0 con 0x7f41e40093b0 2024-08-17T02:46:55.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f41d80013f0 con 0x7f41e40093b0 2024-08-17T02:46:55.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f3e77e00640 1 -- 172.21.15.149:0/804436094 >> v1:172.21.15.149:6789/0 conn(0x7f3e700e1bd0 legacy=0x7f3e700e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.495+0000 7f3e77e00640 1 -- 172.21.15.149:0/804436094 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700074b0 con 0x7f3e70054d00 2024-08-17T02:46:55.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f3e7d600640 1 --2- 172.21.15.149:0/804436094 >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 0x7f3e700e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 >> v1:172.21.15.149:6789/0 conn(0x7f41e40093b0 legacy=0x7f41e4006aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d4003bb0 0x7f41d4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d4004780 0x7f41d4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d4005250 0x7f41d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40502e0 con 0x7f41d4005250 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d400c150 con 0x7f41d4003bb0 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d400c310 con 0x7f41d4004780 2024-08-17T02:46:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.497+0000 7f3e77e00640 1 --2- 172.21.15.149:0/804436094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e70006150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3e7804c0c0 tx=0x7f3e7806f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9adf89612815899 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f4227400640 1 Processor -- start 2024-08-17T02:46:55.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.497+0000 7f3e77400640 1 -- 172.21.15.149:0/804436094 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780a65e0 con 0x7f3e70054d00 2024-08-17T02:46:55.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.497+0000 7f4227400640 1 -- start start 2024-08-17T02:46:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.497+0000 7f3e77400640 1 -- 172.21.15.149:0/804436094 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e780a4050 con 0x7f3e70054d00 2024-08-17T02:46:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.497+0000 7f3e77400640 1 -- 172.21.15.149:0/804436094 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780a6950 con 0x7f3e70054d00 2024-08-17T02:46:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.496+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d4003bb0 0x7f41d4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f1600640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d4005250 0x7f41d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f0c00640 1 -- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d4004780 msgr2=0x7f41d4004bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d4004780 0x7f41d4004bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f0c00640 1 -- 172.21.15.149:0/3273264939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d4005250 msgr2=0x7f41d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d4005250 0x7f41d400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f0c00640 1 -- 172.21.15.149:0/3273264939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40034e0 con 0x7f41d4003bb0 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f41f1600640 1 -- 172.21.15.149:0/3273264939 reap_dead start 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f3e7e000640 1 -- 172.21.15.149:0/804436094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 msgr2=0x7f3e70006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f3e7e000640 1 --2- 172.21.15.149:0/804436094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e70006150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3e7804c0c0 tx=0x7f3e7806f710 comp rx=0 tx=0).stop 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f3e7e000640 1 -- 172.21.15.149:0/804436094 shutdown_connections 2024-08-17T02:46:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f3e7e000640 1 --2- 172.21.15.149:0/804436094 >> v2:172.21.15.161:3300/0 conn(0x7f3e70006690 0x7f3e700e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f3e7e000640 1 --2- 172.21.15.149:0/804436094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e70006150 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.498+0000 7f3e7e000640 1 -- 172.21.15.149:0/804436094 >> 172.21.15.149:0/804436094 conn(0x7f3e7000f070 msgr2=0x7f3e70058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.499+0000 7f3e7e000640 1 -- 172.21.15.149:0/804436094 shutdown_connections 2024-08-17T02:46:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.499+0000 7f4227400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42200b1120 0x7f42200aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.500+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d4003bb0 0x7f41d4003fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001a60 tx=0x7f41e0007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d37e1732a8804d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.500+0000 7f4224a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f42200ada10 0x7f42200b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35544/0 (socket says 172.21.15.149:35544) 2024-08-17T02:46:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.500+0000 7f421fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42200b1120 0x7f42200aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.500+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e002ab10 con 0x7f41d4003bb0 2024-08-17T02:46:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e002ac90 con 0x7f41d4003bb0 2024-08-17T02:46:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f41eb400640 1 -- 172.21.15.149:0/3273264939 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0004ab0 con 0x7f41d4003bb0 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.500+0000 7f421fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42200b1120 0x7f42200aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48166/0 (socket says 172.21.15.149:48166) 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.499+0000 7f3e7e000640 1 -- 172.21.15.149:0/804436094 wait complete. 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f4224a00640 1 -- 172.21.15.149:0/802997246 learned_addr learned my addr 172.21.15.149:0/802997246 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200d0ab0 con 0x7f42200b3370 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200b00c0 con 0x7f42200ada10 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200af330 con 0x7f42200b1120 2024-08-17T02:46:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.500+0000 7f4225400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f42200b3370 0x7f42201629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35632/0 (socket says 172.21.15.149:35632) 2024-08-17T02:46:55.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f3e7e000640 1 Processor -- start 2024-08-17T02:46:55.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f3e7e000640 1 -- start start 2024-08-17T02:46:55.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f421fe00640 1 -- 172.21.15.149:0/802997246 >> v1:172.21.15.161:6789/0 conn(0x7f42200ada10 legacy=0x7f42200b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f421fe00640 1 -- 172.21.15.149:0/802997246 >> v1:172.21.15.149:6789/0 conn(0x7f42200b3370 legacy=0x7f42201629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.501+0000 7f421fe00640 1 -- 172.21.15.149:0/802997246 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200b0360 con 0x7f42200b1120 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 -- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d4003bb0 msgr2=0x7f41d4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d4003bb0 0x7f41d4003fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001a60 tx=0x7f41e0007d90 comp rx=0 tx=0).stop 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 -- 172.21.15.149:0/3273264939 shutdown_connections 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 --2- 172.21.15.149:0/3273264939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d4003bb0 0x7f41d4003fc0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001a60 tx=0x7f41e0007d90 comp rx=0 tx=0).stop 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 -- 172.21.15.149:0/3273264939 >> 172.21.15.149:0/3273264939 conn(0x7f41e4052710 msgr2=0x7f41e4052b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 -- 172.21.15.149:0/3273264939 shutdown_connections 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f49e7e00640 1 Processor -- start 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.503+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 0x7f3e700d54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e700e2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e700e1bd0 0x7f3e700528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f3e7cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 0x7f3e700d54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f3e7cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 0x7f3e700d54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36896/0 (socket says 172.21.15.149:36896) 2024-08-17T02:46:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f3e77e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e700e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.503+0000 7f49e7e00640 1 -- start start 2024-08-17T02:46:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.503+0000 7f421fe00640 1 --2- 172.21.15.149:0/802997246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b1120 0x7f42200aedf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4218009e60 tx=0x7f4218009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811ceaac9e746b58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f421f400640 1 -- 172.21.15.149:0/802997246 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218007550 con 0x7f42200b1120 2024-08-17T02:46:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f421f400640 1 -- 172.21.15.149:0/802997246 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421802d050 con 0x7f42200b1120 2024-08-17T02:46:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f421f400640 1 -- 172.21.15.149:0/802997246 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218007550 con 0x7f42200b1120 2024-08-17T02:46:55.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.502+0000 7f41f3600640 1 -- 172.21.15.149:0/3273264939 wait complete. 2024-08-17T02:46:55.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f49e7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f41f3600640 1 Processor -- start 2024-08-17T02:46:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b1120 msgr2=0x7f42200aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f4227400640 1 --2- 172.21.15.149:0/802997246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b1120 0x7f42200aedf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4218009e60 tx=0x7f4218009780 comp rx=0 tx=0).stop 2024-08-17T02:46:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f41f3600640 1 -- start start 2024-08-17T02:46:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.504+0000 7f3e77e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e700e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:51094/0 (socket says 172.21.15.149:51094) 2024-08-17T02:46:55.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f49e7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49e80cc9d0 0x7f49e80acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f3e7d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e700e1bd0 0x7f3e700528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f3e7cc00640 1 -- 172.21.15.149:0/2607383228 learned_addr learned my addr 172.21.15.149:0/2607383228 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 shutdown_connections 2024-08-17T02:46:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f4227400640 1 --2- 172.21.15.149:0/802997246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b1120 0x7f42200aedf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 >> 172.21.15.149:0/802997246 conn(0x7f42200cfdf0 msgr2=0x7f42200d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f49de000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f49e80cd700 0x7f49e80cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35556/0 (socket says 172.21.15.149:35556) 2024-08-17T02:46:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f49e7e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80cf9d0 con 0x7f49e80cd700 2024-08-17T02:46:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f49e7e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80ceb60 con 0x7f49e80cc9d0 2024-08-17T02:46:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f49e7e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80cedc0 con 0x7f49e8158c80 2024-08-17T02:46:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700d5a00 con 0x7f3e700e1bd0 2024-08-17T02:46:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f49e6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f49e6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:51102/0 (socket says 172.21.15.149:51102) 2024-08-17T02:46:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f49e6a00640 1 -- 172.21.15.149:0/493189325 learned_addr learned my addr 172.21.15.149:0/493189325 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700e2f50 con 0x7f3e70006690 2024-08-17T02:46:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700e3230 con 0x7f3e70054d00 2024-08-17T02:46:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.506+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 shutdown_connections 2024-08-17T02:46:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.505+0000 7f3e7d600640 1 -- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 msgr2=0x7f3e700e2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f4227400640 1 -- 172.21.15.149:0/802997246 wait complete. 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f41f3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e40fe9b0 0x7f41e40eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f41f3600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 0x7f41e40e8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f41f3600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41e40dccb0 0x7f41e40dd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f41ebe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 0x7f41e40e8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f3e7d600640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e700e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f3e7d600640 1 -- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 msgr2=0x7f3e700d54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f3e7d600640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 0x7f3e700d54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f3e7d600640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009450 con 0x7f3e700e1bd0 2024-08-17T02:46:55.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f3e7cc00640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 0x7f3e700d54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f3e7d600640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e700e1bd0 0x7f3e700528e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400e980 tx=0x7f3e640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f49e6a00640 1 -- 172.21.15.149:0/493189325 >> v2:172.21.15.149:3300/0 conn(0x7f49e80cc9d0 msgr2=0x7f49e80acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f49e6a00640 1 --2- 172.21.15.149:0/493189325 >> v2:172.21.15.149:3300/0 conn(0x7f49e80cc9d0 0x7f49e80acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f49e6a00640 1 -- 172.21.15.149:0/493189325 >> v1:172.21.15.161:6789/0 conn(0x7f49e80cd700 legacy=0x7f49e80cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.507+0000 7f49e6a00640 1 -- 172.21.15.149:0/493189325 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80cf0a0 con 0x7f49e8158c80 2024-08-17T02:46:55.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400c940 con 0x7f3e700e1bd0 2024-08-17T02:46:55.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6400caa0 con 0x7f3e700e1bd0 2024-08-17T02:46:55.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400ce60 con 0x7f3e700e1bd0 2024-08-17T02:46:55.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f41ebe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 0x7f41e40e8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36908/0 (socket says 172.21.15.149:36908) 2024-08-17T02:46:55.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f41ebe00640 1 -- 172.21.15.149:0/3379201952 learned_addr learned my addr 172.21.15.149:0/3379201952 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7804c200 con 0x7f3e700e1bd0 2024-08-17T02:46:55.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f3e77e00640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e700e2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-17T02:46:55.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.508+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e700e37f0 con 0x7f3e700e1bd0 2024-08-17T02:46:55.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.509+0000 7f41f1600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41e40dccb0 0x7f41e40dd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.509+0000 7f49e6a00640 1 --2- 172.21.15.149:0/493189325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80ce620 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009f20 tx=0x7f49d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a2b49d8f767c79 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.509+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40e9320 con 0x7f41e40fe9b0 2024-08-17T02:46:55.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.509+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40e6b40 con 0x7f41e40e8970 2024-08-17T02:46:55.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.509+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40e79a0 con 0x7f41e40dccb0 2024-08-17T02:46:55.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.509+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e40fe9b0 0x7f41e40eb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41f1600640 1 -- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 msgr2=0x7f41e40e8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f49e6000640 1 -- 172.21.15.149:0/493189325 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8007400 con 0x7f49e8158c80 2024-08-17T02:46:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f49e6000640 1 -- 172.21.15.149:0/493189325 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8007560 con 0x7f49e8158c80 2024-08-17T02:46:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41f1600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 0x7f41e40e8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f49e6000640 1 -- 172.21.15.149:0/493189325 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8007940 con 0x7f49e8158c80 2024-08-17T02:46:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41f1600640 1 -- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e40fe9b0 msgr2=0x7f41e40eb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41f1600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e40fe9b0 0x7f41e40eb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41f1600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e40e6d90 con 0x7f41e40dccb0 2024-08-17T02:46:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41ebe00640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 0x7f41e40e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41f1600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41e40dccb0 0x7f41e40dd150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41ec000b60 tx=0x7f41ec069040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec06d070 con 0x7f41e40dccb0 2024-08-17T02:46:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f4227400640 1 Processor -- start 2024-08-17T02:46:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec063f30 con 0x7f41e40dccb0 2024-08-17T02:46:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.511+0000 7f4227400640 1 -- start start 2024-08-17T02:46:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec064320 con 0x7f41e40dccb0 2024-08-17T02:46:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.510+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e70005320 con 0x7f3e700e1bd0 2024-08-17T02:46:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.511+0000 7f49e7e00640 1 -- 172.21.15.149:0/493189325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 msgr2=0x7f49e80ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.511+0000 7f49e7e00640 1 --2- 172.21.15.149:0/493189325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80ce620 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009f20 tx=0x7f49d8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.511+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e40e7070 con 0x7f41e40dccb0 2024-08-17T02:46:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f94d1200640 1 Processor -- start 2024-08-17T02:46:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e40e7630 con 0x7f41e40dccb0 2024-08-17T02:46:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f49e7e00640 1 -- 172.21.15.149:0/493189325 shutdown_connections 2024-08-17T02:46:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f49e7e00640 1 --2- 172.21.15.149:0/493189325 >> v2:172.21.15.149:3300/0 conn(0x7f49e80cc9d0 0x7f49e80acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f49e7e00640 1 --2- 172.21.15.149:0/493189325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80ce620 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f49e7e00640 1 -- 172.21.15.149:0/493189325 >> 172.21.15.149:0/493189325 conn(0x7f49e8098e30 msgr2=0x7f49e806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.512+0000 7f94d1200640 1 -- start start 2024-08-17T02:46:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4227400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42200ada10 0x7f4220067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f013de00640 1 Processor -- start 2024-08-17T02:46:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4227400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42200b1120 0x7f4220067a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4227400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 0x7f4220170550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4227400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42200cf520 con 0x7f42200b3370 2024-08-17T02:46:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4227400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42200cf240 con 0x7f42200ada10 2024-08-17T02:46:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4227400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42200cc6e0 con 0x7f42200b1120 2024-08-17T02:46:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f49e7e00640 1 -- 172.21.15.149:0/493189325 shutdown_connections 2024-08-17T02:46:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4225400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 0x7f4220170550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f4224a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42200ada10 0x7f4220067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f421fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42200b1120 0x7f4220067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.513+0000 7f013de00640 1 -- start start 2024-08-17T02:46:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e4005770 con 0x7f41e40dccb0 2024-08-17T02:46:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f4225400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 0x7f4220170550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48212/0 (socket says 172.21.15.149:48212) 2024-08-17T02:46:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f4225400640 1 -- 172.21.15.149:0/492849942 learned_addr learned my addr 172.21.15.149:0/492849942 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f49e7e00640 1 -- 172.21.15.149:0/493189325 wait complete. 2024-08-17T02:46:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f4224a00640 1 -- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42200b1120 msgr2=0x7f4220067a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f4224a00640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42200b1120 0x7f4220067a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f4224a00640 1 -- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 msgr2=0x7f4220170550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f4224a00640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 0x7f4220170550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f94d1200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94c40500f0 0x7f94c4005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f4224a00640 1 -- 172.21.15.149:0/492849942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009a20 con 0x7f42200ada10 2024-08-17T02:46:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f94cb400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f94c40e09f0 0x7f94c404f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35570/0 (socket says 172.21.15.149:35570) 2024-08-17T02:46:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f94cb400640 1 -- 172.21.15.149:0/476659234 learned_addr learned my addr 172.21.15.149:0/476659234 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f4225400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 0x7f4220170550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f013de00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f013815d830 0x7f013806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f4224a00640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42200ada10 0x7f4220067510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f421000c490 tx=0x7f4210007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f94caa00640 1 --2- 172.21.15.149:0/476659234 >> v2:172.21.15.161:3300/0 conn(0x7f94c40500f0 0x7f94c4005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f013de00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01380b0610 0x7f013815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.514+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f41ec099440 con 0x7f41e40dccb0 2024-08-17T02:46:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.515+0000 7f41dfe00640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f41cc0652c0 0x7f41cc067770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41ec0f8250 con 0x7f41e40dccb0 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f013de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f013815d830 0x7f013806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f013de00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01380b1b20 con 0x7f01380b0610 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f013de00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01380b1690 con 0x7f013815d830 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f013de00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380ae4a0 con 0x7f013815e140 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f013815d830 0x7f013806e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36950/0 (socket says 172.21.15.149:36950) 2024-08-17T02:46:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 -- 172.21.15.149:0/3412850457 learned_addr learned my addr 172.21.15.149:0/3412850457 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c4006c30 con 0x7f94c4006440 2024-08-17T02:46:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c4006f10 con 0x7f94c40e09f0 2024-08-17T02:46:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40375b0 con 0x7f94c40500f0 2024-08-17T02:46:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3e64013680 con 0x7f3e700e1bd0 2024-08-17T02:46:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f3e6be00640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3e58065220 0x7f3e580676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e640824a0 con 0x7f3e700e1bd0 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f49e7e00640 1 Processor -- start 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f49e7e00640 1 -- start start 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210005aa0 con 0x7f42200ada10 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4210005c00 con 0x7f42200ada10 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210005030 con 0x7f42200ada10 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f94ca000640 1 -- 172.21.15.149:0/476659234 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019776697 0 0) 0x7f94c4006f10 con 0x7f94c40e09f0 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f94ca000640 1 -- 172.21.15.149:0/476659234 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b40034e0 con 0x7f94c40e09f0 2024-08-17T02:46:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f94caa00640 1 -- 172.21.15.149:0/476659234 >> v1:172.21.15.161:6789/0 conn(0x7f94c40e09f0 legacy=0x7f94c404f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f94caa00640 1 -- 172.21.15.149:0/476659234 >> v1:172.21.15.149:6789/0 conn(0x7f94c4006440 legacy=0x7f94c4053000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f94caa00640 1 -- 172.21.15.149:0/476659234 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40071f0 con 0x7f94c40500f0 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f012e000640 1 --2- 172.21.15.149:0/3412850457 >> v2:172.21.15.149:3300/0 conn(0x7f01380b0610 0x7f013815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 -- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 msgr2=0x7f013815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 --2- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 -- 172.21.15.149:0/3412850457 >> v2:172.21.15.149:3300/0 conn(0x7f01380b0610 msgr2=0x7f013815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 --2- 172.21.15.149:0/3412850457 >> v2:172.21.15.149:3300/0 conn(0x7f01380b0610 0x7f013815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.516+0000 7f0136a00640 1 -- 172.21.15.149:0/3412850457 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013815b200 con 0x7f013815d830 2024-08-17T02:46:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.517+0000 7f012e000640 1 --2- 172.21.15.149:0/3412850457 >> v2:172.21.15.149:3300/0 conn(0x7f01380b0610 0x7f013815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.518+0000 7f3e7cc00640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3e58065220 0x7f3e580676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.518+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f41cc0652c0 0x7f41cc067770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.518+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200cc9c0 con 0x7f42200ada10 2024-08-17T02:46:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.518+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220158750 con 0x7f42200ada10 2024-08-17T02:46:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f41f0c00640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f41cc0652c0 0x7f41cc067770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41e0032000 tx=0x7f41e002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e80cc9d0 0x7f49e8156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f3e7cc00640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3e58065220 0x7f3e580676d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0019c0 tx=0x7f3e6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 0x7f49e8156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8157820 con 0x7f49e80cc9d0 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b3740 con 0x7f49e80cd700 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b5390 con 0x7f49e8158c80 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49de000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 0x7f49e8156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49de000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 0x7f49e8156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36964/0 (socket says 172.21.15.149:36964) 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49de000640 1 -- 172.21.15.149:0/2285289047 learned_addr learned my addr 172.21.15.149:0/2285289047 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.519+0000 7f49e7400640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42200cc540 con 0x7f42200ada10 2024-08-17T02:46:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49de000640 1 -- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 msgr2=0x7f49e80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49de000640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49de000640 1 -- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e80cc9d0 msgr2=0x7f49e8156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f94caa00640 1 --2- 172.21.15.149:0/476659234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c40500f0 0x7f94c4005f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009850 tx=0x7f94c00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bc966d3d7d6f5e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49e6a00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e80cc9d0 0x7f49e8156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49de000640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e80cc9d0 0x7f49e8156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49de000640 1 -- 172.21.15.149:0/2285289047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009ae0 con 0x7f49e80cd700 2024-08-17T02:46:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49e6a00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e80cc9d0 0x7f49e8156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f49de000640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 0x7f49e8156f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49d000c590 tx=0x7f49d0007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f0136a00640 1 --2- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013806e1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f013806bc00 tx=0x7f01200091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4cc0080873da378 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.520+0000 7f94ca000640 1 -- 172.21.15.149:0/476659234 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c002ac40 con 0x7f94c40500f0 2024-08-17T02:46:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f94ca000640 1 -- 172.21.15.149:0/476659234 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c002ada0 con 0x7f94c40500f0 2024-08-17T02:46:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f94ca000640 1 -- 172.21.15.149:0/476659234 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0032670 con 0x7f94c40500f0 2024-08-17T02:46:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f61ac200640 1 Processor -- start 2024-08-17T02:46:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d00072e0 con 0x7f49e80cd700 2024-08-17T02:46:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0007480 con 0x7f49e80cd700 2024-08-17T02:46:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d00049f0 con 0x7f49e80cd700 2024-08-17T02:46:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80b2980 con 0x7f49e80cd700 2024-08-17T02:46:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80b3220 con 0x7f49e80cd700 2024-08-17T02:46:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f41ec0c63a0 con 0x7f41e40dccb0 2024-08-17T02:46:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4210005440 con 0x7f42200ada10 2024-08-17T02:46:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.522+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c40500f0 msgr2=0x7f94c4005f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.522+0000 7f94d1200640 1 --2- 172.21.15.149:0/476659234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c40500f0 0x7f94c4005f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009850 tx=0x7f94c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.522+0000 7f0136000640 1 -- 172.21.15.149:0/3412850457 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012002add0 con 0x7f013815d830 2024-08-17T02:46:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.522+0000 7f0136000640 1 -- 172.21.15.149:0/3412850457 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120032440 con 0x7f013815d830 2024-08-17T02:46:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.522+0000 7f0136000640 1 -- 172.21.15.149:0/3412850457 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120032820 con 0x7f013815d830 2024-08-17T02:46:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.522+0000 7f5926c00640 1 Processor -- start 2024-08-17T02:46:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 shutdown_connections 2024-08-17T02:46:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f94d1200640 1 --2- 172.21.15.149:0/476659234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c40500f0 0x7f94c4005f00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f5926c00640 1 -- start start 2024-08-17T02:46:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 >> 172.21.15.149:0/476659234 conn(0x7f94c4009fa0 msgr2=0x7f94c400a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 -- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 msgr2=0x7f013806e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 --2- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013806e1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f013806bc00 tx=0x7f01200091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 -- 172.21.15.149:0/3412850457 shutdown_connections 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 --2- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 --2- 172.21.15.149:0/3412850457 >> v2:172.21.15.149:3300/0 conn(0x7f01380b0610 0x7f013815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 --2- 172.21.15.149:0/3412850457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013806e1b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f013de00640 1 -- 172.21.15.149:0/3412850457 >> 172.21.15.149:0/3412850457 conn(0x7f01380cb9b0 msgr2=0x7f01380cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80b2d80 con 0x7f49e80cd700 2024-08-17T02:46:55.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f4217e00640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4200065220 0x7f42000676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 shutdown_connections 2024-08-17T02:46:55.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4210081620 con 0x7f42200ada10 2024-08-17T02:46:55.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f94d1200640 1 -- 172.21.15.149:0/476659234 wait complete. 2024-08-17T02:46:55.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.521+0000 7f61ac200640 1 -- start start 2024-08-17T02:46:55.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f013de00640 1 -- 172.21.15.149:0/3412850457 shutdown_connections 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f61ac200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61a40b0610 0x7f61a415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f61ac200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a40b1690 con 0x7f61a415e140 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f61ac200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a40ae4a0 con 0x7f61a415d830 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f61ac200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a406e8c0 con 0x7f61a40b0610 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.523+0000 7f61a8e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61a40b0610 0x7f61a415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f61a8e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61a40b0610 0x7f61a415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36968/0 (socket says 172.21.15.149:36968) 2024-08-17T02:46:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f61a8e00640 1 -- 172.21.15.149:0/3365682375 learned_addr learned my addr 172.21.15.149:0/3365682375 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f421fe00640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4200065220 0x7f42000676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f61a8e00640 1 -- 172.21.15.149:0/3365682375 >> v1:172.21.15.161:6789/0 conn(0x7f61a415d830 legacy=0x7f61a406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.524+0000 7f61a8e00640 1 -- 172.21.15.149:0/3365682375 >> v1:172.21.15.149:6789/0 conn(0x7f61a415e140 legacy=0x7f61a4166e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f49d0013400 con 0x7f49e80cd700 2024-08-17T02:46:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f421fe00640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4200065220 0x7f42000676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4218034000 tx=0x7f4218037000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.525+0000 7f61a8e00640 1 -- 172.21.15.149:0/3365682375 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a415b200 con 0x7f61a40b0610 2024-08-17T02:46:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.525+0000 7f5926c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5920159060 0x7f59200c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.525+0000 7f5926c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59200c6a30 0x7f59200d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.525+0000 7f5926c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200cbf40 con 0x7f5920159430 2024-08-17T02:46:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.525+0000 7f5926c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200cb930 con 0x7f59200c6a30 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.525+0000 7f5926c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200ced10 con 0x7f5920159060 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f591fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5920159060 0x7f59200c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f591fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5920159060 0x7f59200c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36984/0 (socket says 172.21.15.149:36984) 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f591fe00640 1 -- 172.21.15.149:0/3280288435 learned_addr learned my addr 172.21.15.149:0/3280288435 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f591f400640 1 --2- 172.21.15.149:0/3280288435 >> v2:172.21.15.149:3300/0 conn(0x7f59200c6a30 0x7f59200d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f591fe00640 1 -- 172.21.15.149:0/3280288435 >> v2:172.21.15.149:3300/0 conn(0x7f59200c6a30 msgr2=0x7f59200d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f61a8e00640 1 --2- 172.21.15.149:0/3365682375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a415dc00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f619001a930 tx=0x7f619001a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ef8bdb27cf9f0fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f94d1200640 1 Processor -- start 2024-08-17T02:46:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f94d1200640 1 -- start start 2024-08-17T02:46:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3e640505e0 con 0x7f3e700e1bd0 2024-08-17T02:46:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.526+0000 7f013de00640 1 -- 172.21.15.149:0/3412850457 wait complete. 2024-08-17T02:46:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f49dea00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49c40652a0 0x7f49c4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49d0081830 con 0x7f49e80cd700 2024-08-17T02:46:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f591fe00640 1 --2- 172.21.15.149:0/3280288435 >> v2:172.21.15.149:3300/0 conn(0x7f59200c6a30 0x7f59200d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f591fe00640 1 -- 172.21.15.149:0/3280288435 >> v1:172.21.15.161:6789/0 conn(0x7f5920159430 legacy=0x7f59200cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.527+0000 7f591fe00640 1 -- 172.21.15.149:0/3280288435 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59200cbbd0 con 0x7f5920159060 2024-08-17T02:46:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f013de00640 1 Processor -- start 2024-08-17T02:46:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f013de00640 1 -- start start 2024-08-17T02:46:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f421004be40 con 0x7f42200ada10 2024-08-17T02:46:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f94d1200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c4006440 0x7f94c404c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f94d1200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 0x7f94c403a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f94d1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c40e09f0 0x7f94c404e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f94d1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40db9a0 con 0x7f94c40e09f0 2024-08-17T02:46:55.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f94d1200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40ddf80 con 0x7f94c4006440 2024-08-17T02:46:55.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.528+0000 7f94d1200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c403a620 con 0x7f94c40500f0 2024-08-17T02:46:55.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f49e6a00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49c40652a0 0x7f49c4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f94cb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c4006440 0x7f94c404c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f94caa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 0x7f94c403a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f94caa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 0x7f94c403a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:51136/0 (socket says 172.21.15.149:51136) 2024-08-17T02:46:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f94caa00640 1 -- 172.21.15.149:0/3328977195 learned_addr learned my addr 172.21.15.149:0/3328977195 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f94cbe00640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c40e09f0 0x7f94c404e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f49e6a00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49c40652a0 0x7f49c4067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49d8033000 tx=0x7f49d8034000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f013de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01380b0610 0x7f013814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f013de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f013de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013816e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f013de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01381503f0 con 0x7f01380b0610 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f013de00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013813b630 con 0x7f013815d830 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.529+0000 7f013de00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013816eaf0 con 0x7f013815e140 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f0136a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01380b0610 0x7f013814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94cb400640 1 -- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 msgr2=0x7f94c403a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94cb400640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 0x7f94c403a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94cb400640 1 -- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c40e09f0 msgr2=0x7f94c404e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94cb400640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c40e09f0 0x7f94c404e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94cb400640 1 -- 172.21.15.149:0/3328977195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c0009390 con 0x7f94c4006440 2024-08-17T02:46:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f012e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f591fe00640 1 --2- 172.21.15.149:0/3280288435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159060 0x7f59200c6e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5920065ea0 tx=0x7f59100091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eacbd7092df98694 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f012e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013814feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:37016/0 (socket says 172.21.15.149:37016) 2024-08-17T02:46:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f012e000640 1 -- 172.21.15.149:0/3931766745 learned_addr learned my addr 172.21.15.149:0/3931766745 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f0137400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013816e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94caa00640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 0x7f94c403a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.530+0000 7f94cb400640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c4006440 0x7f94c404c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94cc060af0 tx=0x7f94cc06f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f0136a00640 1 -- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 msgr2=0x7f013816e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f0136a00640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013816e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f0136a00640 1 -- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 msgr2=0x7f013814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f0136a00640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f0136a00640 1 -- 172.21.15.149:0/3931766745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120009450 con 0x7f01380b0610 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f012e000640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f0136a00640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01380b0610 0x7f013814ea00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0120031000 tx=0x7f0120032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.531+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120031bb0 con 0x7f01380b0610 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120031d50 con 0x7f01380b0610 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012003c650 con 0x7f01380b0610 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f013de00640 1 -- 172.21.15.149:0/3931766745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013816d950 con 0x7f01380b0610 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f013de00640 1 -- 172.21.15.149:0/3931766745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013816df10 con 0x7f01380b0610 2024-08-17T02:46:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.533+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f49d004be40 con 0x7f49e80cd700 2024-08-17T02:46:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.533+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc06f470 con 0x7f94c4006440 2024-08-17T02:46:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.533+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc08f3b0 con 0x7f94c4006440 2024-08-17T02:46:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.533+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc08f7b0 con 0x7f94c4006440 2024-08-17T02:46:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f591ea00640 1 -- 172.21.15.149:0/3280288435 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591002add0 con 0x7f5920159060 2024-08-17T02:46:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f591ea00640 1 -- 172.21.15.149:0/3280288435 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910032440 con 0x7f5920159060 2024-08-17T02:46:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.532+0000 7f591ea00640 1 -- 172.21.15.149:0/3280288435 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910032820 con 0x7f5920159060 2024-08-17T02:46:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.533+0000 7f61a3e00640 1 -- 172.21.15.149:0/3365682375 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619003be70 con 0x7f61a40b0610 2024-08-17T02:46:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.533+0000 7f61a3e00640 1 -- 172.21.15.149:0/3365682375 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190043440 con 0x7f61a40b0610 2024-08-17T02:46:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.534+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0108005210 con 0x7f01380b0610 2024-08-17T02:46:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.534+0000 7f5926c00640 1 -- 172.21.15.149:0/3280288435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159060 msgr2=0x7f59200c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.534+0000 7f5926c00640 1 --2- 172.21.15.149:0/3280288435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159060 0x7f59200c6e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5920065ea0 tx=0x7f59100091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.534+0000 7f61a3e00640 1 -- 172.21.15.149:0/3365682375 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190043820 con 0x7f61a40b0610 2024-08-17T02:46:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f5926c00640 1 -- 172.21.15.149:0/3280288435 shutdown_connections 2024-08-17T02:46:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f5926c00640 1 --2- 172.21.15.149:0/3280288435 >> v2:172.21.15.149:3300/0 conn(0x7f59200c6a30 0x7f59200d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f5926c00640 1 --2- 172.21.15.149:0/3280288435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159060 0x7f59200c6e90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f5926c00640 1 -- 172.21.15.149:0/3280288435 >> 172.21.15.149:0/3280288435 conn(0x7f59200cfde0 msgr2=0x7f59200d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f5926c00640 1 -- 172.21.15.149:0/3280288435 shutdown_connections 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.534+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c40dbda0 con 0x7f94c4006440 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.534+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c40dd650 con 0x7f94c4006440 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.535+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f012003ca80 con 0x7f01380b0610 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.537+0000 7f012ea00640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0114065200 0x7f01140676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.537+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01200a2ef0 con 0x7f01380b0610 2024-08-17T02:46:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.537+0000 7f012e000640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0114065200 0x7f01140676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f61ac200640 1 -- 172.21.15.149:0/3365682375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 msgr2=0x7f61a415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f61ac200640 1 --2- 172.21.15.149:0/3365682375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a415dc00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f619001a930 tx=0x7f619001a1d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c4005320 con 0x7f94c4006440 2024-08-17T02:46:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.537+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94cc08fbe0 con 0x7f94c4006440 2024-08-17T02:46:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.538+0000 7f012e000640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0114065200 0x7f01140676b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01381515e0 tx=0x7f0128008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.536+0000 7f5926c00640 1 -- 172.21.15.149:0/3280288435 wait complete. 2024-08-17T02:46:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.538+0000 7f5926c00640 1 Processor -- start 2024-08-17T02:46:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.538+0000 7f5926c00640 1 -- start start 2024-08-17T02:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f61ac200640 1 -- 172.21.15.149:0/3365682375 shutdown_connections 2024-08-17T02:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f61ac200640 1 --2- 172.21.15.149:0/3365682375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a415dc00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f61ac200640 1 -- 172.21.15.149:0/3365682375 >> 172.21.15.149:0/3365682375 conn(0x7f61a40cb9b0 msgr2=0x7f61a40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f61ac200640 1 -- 172.21.15.149:0/3365682375 shutdown_connections 2024-08-17T02:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f61ac200640 1 -- 172.21.15.149:0/3365682375 wait complete. 2024-08-17T02:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f94bea00640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f94ac065220 0x7f94ac0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.539+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94cc0f8e50 con 0x7f94c4006440 2024-08-17T02:46:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5926c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59200c6a30 0x7f5920152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5926c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920159060 0x7f592014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f94caa00640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f94ac065220 0x7f94ac0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5926c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 0x7f59200b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5926c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920153e70 con 0x7f59200c6a30 2024-08-17T02:46:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5926c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920153270 con 0x7f5920159430 2024-08-17T02:46:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5926c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200b3760 con 0x7f5920159060 2024-08-17T02:46:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.540+0000 7f5924c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 0x7f59200b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 0x7f59200b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:37026/0 (socket says 172.21.15.149:37026) 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f591fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59200c6a30 0x7f5920152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 -- 172.21.15.149:0/1093407978 learned_addr learned my addr 172.21.15.149:0/1093407978 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f591f400640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920159060 0x7f592014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 -- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920159060 msgr2=0x7f592014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920159060 0x7f592014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 -- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59200c6a30 msgr2=0x7f5920152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59200c6a30 0x7f5920152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f5924c00640 1 -- 172.21.15.149:0/1093407978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910009450 con 0x7f5920159430 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f591f400640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920159060 0x7f592014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.541+0000 7f591fe00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59200c6a30 0x7f5920152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.542+0000 7f94caa00640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f94ac065220 0x7f94ac0676d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94c40e01d0 tx=0x7f94c0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.542+0000 7f61ac200640 1 Processor -- start 2024-08-17T02:46:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.542+0000 7f61ac200640 1 -- start start 2024-08-17T02:46:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.542+0000 7f5924c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 0x7f59200b2b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f591800c840 tx=0x7f5918001610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0120071220 con 0x7f01380b0610 2024-08-17T02:46:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61ac200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a413ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61ac200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a415d830 0x7f61a4144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61ac200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61a415e140 0x7f61a415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61ac200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4150270 con 0x7f61a415d830 2024-08-17T02:46:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61ac200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41410e0 con 0x7f61a40b0610 2024-08-17T02:46:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61ac200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a415b420 con 0x7f61a415e140 2024-08-17T02:46:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61a9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800ce30 con 0x7f5920159430 2024-08-17T02:46:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800a7f0 con 0x7f5920159430 2024-08-17T02:46:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200b3a40 con 0x7f5920159430 2024-08-17T02:46:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f94cc0c7040 con 0x7f94c4006440 2024-08-17T02:46:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.543+0000 7f61a9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a413ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:37040/0 (socket says 172.21.15.149:37040) 2024-08-17T02:46:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f61a9800640 1 -- 172.21.15.149:0/72885206 learned_addr learned my addr 172.21.15.149:0/72885206 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800abf0 con 0x7f5920159430 2024-08-17T02:46:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.544+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59200b4000 con 0x7f5920159430 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.545+0000 7f61aa200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61a415e140 0x7f61a415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.545+0000 7f61a8e00640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a415d830 0x7f61a4144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a9800640 1 -- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61a415e140 msgr2=0x7f61a415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a9800640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61a415e140 0x7f61a415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a9800640 1 -- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a415d830 msgr2=0x7f61a4144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a9800640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a415d830 0x7f61a4144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a9800640 1 -- 172.21.15.149:0/72885206 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619001a470 con 0x7f61a40b0610 2024-08-17T02:46:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a8e00640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a415d830 0x7f61a4144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.546+0000 7f61a9800640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a413ef00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f619800c5e0 tx=0x7f6198007ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.547+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198012630 con 0x7f61a40b0610 2024-08-17T02:46:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.547+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5918003030 con 0x7f5920159430 2024-08-17T02:46:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.547+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61980127b0 con 0x7f61a40b0610 2024-08-17T02:46:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.547+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198012bb0 con 0x7f61a40b0610 2024-08-17T02:46:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.548+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a4147160 con 0x7f61a40b0610 2024-08-17T02:46:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.548+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a415b9c0 con 0x7f61a40b0610 2024-08-17T02:46:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.548+0000 7f5917400640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f59000652a0 0x7f5900067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.548+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59180823a0 con 0x7f5920159430 2024-08-17T02:46:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.550+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4064db0 con 0x7f61a40b0610 2024-08-17T02:46:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.548+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f8005210 con 0x7f5920159430 2024-08-17T02:46:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.550+0000 7f591fe00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f59000652a0 0x7f5900067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.551+0000 7f591fe00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f59000652a0 0x7f5900067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5910034000 tx=0x7f5910032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.552+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f619801a3b0 con 0x7f61a40b0610 2024-08-17T02:46:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.553+0000 7f61a0c00640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61840652a0 0x7f6184067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.553+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6198081fa0 con 0x7f61a40b0610 2024-08-17T02:46:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.554+0000 7f61a8e00640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61840652a0 0x7f6184067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.554+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5918050440 con 0x7f5920159430 2024-08-17T02:46:55.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.555+0000 7f61a8e00640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61840652a0 0x7f6184067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6190045000 tx=0x7f6190043000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.559+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6198050040 con 0x7f61a40b0610 2024-08-17T02:46:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.923+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41e40e7ae0 con 0x7f41e40dccb0 2024-08-17T02:46:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.924+0000 7f41dfe00640 1 -- 172.21.15.149:0/3379201952 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41ec094020 con 0x7f41e40dccb0 2024-08-17T02:46:55.927 INFO:teuthology.orchestra.run.smithi149.stdout:60129542150 2024-08-17T02:46:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.927+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f41cc0652c0 msgr2=0x7f41cc067770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.927+0000 7f41f3600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f41cc0652c0 0x7f41cc067770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41e0032000 tx=0x7f41e002f000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.927+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41e40dccb0 msgr2=0x7f41e40dd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.927+0000 7f41f3600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41e40dccb0 0x7f41e40dd150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41ec000b60 tx=0x7f41ec069040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 shutdown_connections 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f41cc0652c0 0x7f41cc067770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41e40dccb0 0x7f41e40dd150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e40e8970 0x7f41e40e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 --2- 172.21.15.149:0/3379201952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e40fe9b0 0x7f41e40eb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 >> 172.21.15.149:0/3379201952 conn(0x7f41e4052710 msgr2=0x7f41e4053800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 shutdown_connections 2024-08-17T02:46:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.929+0000 7f41f3600640 1 -- 172.21.15.149:0/3379201952 wait complete. 2024-08-17T02:46:55.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.945+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4220064db0 con 0x7f42200ada10 2024-08-17T02:46:55.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.946+0000 7f4217e00640 1 -- 172.21.15.149:0/492849942 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42200cc540 con 0x7f42200ada10 2024-08-17T02:46:55.950 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:55.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.950+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e7003c240 con 0x7f3e700e1bd0 2024-08-17T02:46:55.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.950+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4200065220 msgr2=0x7f42000676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.950+0000 7f4227400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4200065220 0x7f42000676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4218034000 tx=0x7f4218037000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.950+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42200ada10 msgr2=0x7f4220067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.950+0000 7f4227400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42200ada10 0x7f4220067510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f421000c490 tx=0x7f4210007e20 comp rx=0 tx=0).stop 2024-08-17T02:46:55.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f3e6be00640 1 -- 172.21.15.149:0/2607383228 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e64017020 con 0x7f3e700e1bd0 2024-08-17T02:46:55.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 shutdown_connections 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f4227400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4200065220 0x7f42000676d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f4227400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42200b3370 0x7f4220170550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f4227400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42200b1120 0x7f4220067a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f4227400640 1 --2- 172.21.15.149:0/492849942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42200ada10 0x7f4220067510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.951+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 >> 172.21.15.149:0/492849942 conn(0x7f42200cfdf0 msgr2=0x7f422015aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.952+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 shutdown_connections 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:55.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.952+0000 7f4227400640 1 -- 172.21.15.149:0/492849942 wait complete. 2024-08-17T02:46:55.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-08-17T02:46:55.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3e58065220 msgr2=0x7f3e580676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3e58065220 0x7f3e580676d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0019c0 tx=0x7f3e6c009040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e700e1bd0 msgr2=0x7f3e700528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e700e1bd0 0x7f3e700528e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400e980 tx=0x7f3e640091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 shutdown_connections 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3e58065220 0x7f3e580676d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e700e1bd0 0x7f3e700528e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e70054d00 0x7f3e700e2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 --2- 172.21.15.149:0/2607383228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e70006690 0x7f3e700d54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.955+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 >> 172.21.15.149:0/2607383228 conn(0x7f3e7000f070 msgr2=0x7f3e700e12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.956+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 shutdown_connections 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.956+0000 7f3e7e000640 1 -- 172.21.15.149:0/2607383228 wait complete. 2024-08-17T02:46:55.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.957+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58f80054c0 con 0x7f5920159430 2024-08-17T02:46:55.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.958+0000 7f5917400640 1 -- 172.21.15.149:0/1093407978 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5918053a60 con 0x7f5920159430 2024-08-17T02:46:55.958 INFO:teuthology.orchestra.run.smithi149.stdout:64424509446 2024-08-17T02:46:55.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.958+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f01080054c0 con 0x7f01380b0610 2024-08-17T02:46:55.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.959+0000 7f012ea00640 1 -- 172.21.15.149:0/3931766745 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01200746a0 con 0x7f01380b0610 2024-08-17T02:46:55.960 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:55.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.960+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f94c4052a70 con 0x7f94c4006440 2024-08-17T02:46:55.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.960+0000 7f94bea00640 1 -- 172.21.15.149:0/3328977195 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94cc08b020 con 0x7f94c4006440 2024-08-17T02:46:55.961 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:55.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f59000652a0 msgr2=0x7f5900067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.963 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f59000652a0 0x7f5900067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5910034000 tx=0x7f5910032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 msgr2=0x7f59200b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 0x7f59200b2b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f591800c840 tx=0x7f5918001610 comp rx=0 tx=0).stop 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 shutdown_connections 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f59000652a0 0x7f5900067750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920159430 0x7f59200b2b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920159060 0x7f592014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 --2- 172.21.15.149:0/1093407978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59200c6a30 0x7f5920152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.962+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 >> 172.21.15.149:0/1093407978 conn(0x7f59200cfde0 msgr2=0x7f59200680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.963+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 shutdown_connections 2024-08-17T02:46:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.963+0000 7f5926c00640 1 -- 172.21.15.149:0/1093407978 wait complete. 2024-08-17T02:46:55.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.964+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0114065200 msgr2=0x7f01140676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.964+0000 7f0127400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0114065200 0x7f01140676b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01381515e0 tx=0x7f0128008040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.964+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01380b0610 msgr2=0x7f013814ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.964+0000 7f0127400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01380b0610 0x7f013814ea00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0120031000 tx=0x7f0120032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 shutdown_connections 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0114065200 0x7f01140676b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f013815e140 0x7f013816e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815d830 0x7f013814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 --2- 172.21.15.149:0/3931766745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01380b0610 0x7f013814ea00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 >> 172.21.15.149:0/3931766745 conn(0x7f01380cb9b0 msgr2=0x7f0138156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 shutdown_connections 2024-08-17T02:46:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f94ac065220 msgr2=0x7f94ac0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f94d1200640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f94ac065220 0x7f94ac0676d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94c40e01d0 tx=0x7f94c0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f0127400640 1 -- 172.21.15.149:0/3931766745 wait complete. 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c4006440 msgr2=0x7f94c404c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.965+0000 7f94d1200640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c4006440 0x7f94c404c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94cc060af0 tx=0x7f94cc06f710 comp rx=0 tx=0).stop 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 shutdown_connections 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f94ac065220 0x7f94ac0676d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c40e09f0 0x7f94c404e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c40500f0 0x7f94c403a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 --2- 172.21.15.149:0/3328977195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c4006440 0x7f94c404c610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 >> 172.21.15.149:0/3328977195 conn(0x7f94c4009fa0 msgr2=0x7f94c40dec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 shutdown_connections 2024-08-17T02:46:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.966+0000 7f94d1200640 1 -- 172.21.15.149:0/3328977195 wait complete. 2024-08-17T02:46:55.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.971+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49e8071050 con 0x7f49e80cd700 2024-08-17T02:46:55.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.972+0000 7f49dea00640 1 -- 172.21.15.149:0/2285289047 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49d004f8d0 con 0x7f49e80cd700 2024-08-17T02:46:55.973 INFO:teuthology.orchestra.run.smithi149.stdout:64424509445 2024-08-17T02:46:55.973 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.973+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f61a40ae280 con 0x7f61a40b0610 2024-08-17T02:46:55.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.973+0000 7f61a0c00640 1 -- 172.21.15.149:0/72885206 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6198053660 con 0x7f61a40b0610 2024-08-17T02:46:55.975 INFO:teuthology.orchestra.run.smithi149.stdout:64424509446 2024-08-17T02:46:55.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49c40652a0 msgr2=0x7f49c4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49c40652a0 0x7f49c4067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49d8033000 tx=0x7f49d8034000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 msgr2=0x7f49e8156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 0x7f49e8156f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49d000c590 tx=0x7f49d0007ea0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 shutdown_connections 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49c40652a0 0x7f49c4067750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e8158c80 0x7f49e80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e80cd700 0x7f49e8156f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.978+0000 7f49e7e00640 1 --2- 172.21.15.149:0/2285289047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e80cc9d0 0x7f49e8156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.979+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 >> 172.21.15.149:0/2285289047 conn(0x7f49e8098e30 msgr2=0x7f49e815c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.979+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 shutdown_connections 2024-08-17T02:46:55.981 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.979+0000 7f49e7e00640 1 -- 172.21.15.149:0/2285289047 wait complete. 2024-08-17T02:46:55.981 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.979+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61840652a0 msgr2=0x7f6184067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.981 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.979+0000 7f61ac200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61840652a0 0x7f6184067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6190045000 tx=0x7f6190043000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 msgr2=0x7f61a413ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a413ef00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f619800c5e0 tx=0x7f6198007ed0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 shutdown_connections 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61840652a0 0x7f6184067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61a415e140 0x7f61a415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a415d830 0x7f61a4144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 --2- 172.21.15.149:0/72885206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b0610 0x7f61a413ef00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.980+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 >> 172.21.15.149:0/72885206 conn(0x7f61a40cb9b0 msgr2=0x7f61a40cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.982+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 shutdown_connections 2024-08-17T02:46:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:55.982+0000 7f61ac200640 1 -- 172.21.15.149:0/72885206 wait complete. 2024-08-17T02:46:55.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-08-17T02:46:55.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-08-17T02:46:55.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-08-17T02:46:55.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-08-17T02:46:56.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-08-17T02:46:56.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-08-17T02:46:56.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:46:56.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:46:56.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:46:56.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:46:56.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:46:56.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:46:57.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:46:57.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:46:57.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.183+0000 7f2c0ca00640 1 Processor -- start 2024-08-17T02:46:57.185 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.183+0000 7f2c0ca00640 1 -- start start 2024-08-17T02:46:57.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.185+0000 7f2c0ca00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2c000e62c0 0x7f2c000e6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.185+0000 7f2c0ca00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c000525c0 con 0x7f2c000552e0 2024-08-17T02:46:57.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.185+0000 7f2c0ca00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c00052840 con 0x7f2c000521d0 2024-08-17T02:46:57.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.185+0000 7f2c0ca00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c000534c0 con 0x7f2c000e62c0 2024-08-17T02:46:57.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.186+0000 7f2c05e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2c000e62c0 0x7f2c000e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.186+0000 7f2c05e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2c000e62c0 0x7f2c000e6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:58092/0 (socket says 172.21.15.149:58092) 2024-08-17T02:46:57.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.186+0000 7f2c05e00640 1 -- 172.21.15.149:0/216542624 learned_addr learned my addr 172.21.15.149:0/216542624 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.186+0000 7f2c05400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2c000552e0 0x7f2c00051ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37970/0 (socket says 172.21.15.149:37970) 2024-08-17T02:46:57.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.187+0000 7f2c05e00640 1 -- 172.21.15.149:0/216542624 >> v1:172.21.15.161:6789/0 conn(0x7f2c000521d0 legacy=0x7f2c00007c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:57.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.187+0000 7f2c05e00640 1 -- 172.21.15.149:0/216542624 >> v1:172.21.15.149:6789/0 conn(0x7f2c000552e0 legacy=0x7f2c00051ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.187+0000 7f2c05e00640 1 -- 172.21.15.149:0/216542624 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00052b20 con 0x7f2c000e62c0 2024-08-17T02:46:57.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.189+0000 7f2c05e00640 1 --2- 172.21.15.149:0/216542624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000e62c0 0x7f2c000e6690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009910 tx=0x7f2bf40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeaf795f49d8bb13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.189+0000 7f2c04a00640 1 -- 172.21.15.149:0/216542624 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402ae00 con 0x7f2c000e62c0 2024-08-17T02:46:57.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.189+0000 7f2c04a00640 1 -- 172.21.15.149:0/216542624 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf4032440 con 0x7f2c000e62c0 2024-08-17T02:46:57.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.189+0000 7f2c04a00640 1 -- 172.21.15.149:0/216542624 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402ae00 con 0x7f2c000e62c0 2024-08-17T02:46:57.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.190+0000 7f2c0ca00640 1 -- 172.21.15.149:0/216542624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000e62c0 msgr2=0x7f2c000e6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.190+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/216542624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000e62c0 0x7f2c000e6690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009910 tx=0x7f2bf40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.191+0000 7f2c0ca00640 1 -- 172.21.15.149:0/216542624 shutdown_connections 2024-08-17T02:46:57.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.191+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/216542624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000e62c0 0x7f2c000e6690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.191+0000 7f2c0ca00640 1 -- 172.21.15.149:0/216542624 >> 172.21.15.149:0/216542624 conn(0x7f2c00057870 msgr2=0x7f2c00009ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.191+0000 7f2c0ca00640 1 -- 172.21.15.149:0/216542624 shutdown_connections 2024-08-17T02:46:57.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.191+0000 7f2c0ca00640 1 -- 172.21.15.149:0/216542624 wait complete. 2024-08-17T02:46:57.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.194+0000 7f2c0ca00640 1 Processor -- start 2024-08-17T02:46:57.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.194+0000 7f2c0ca00640 1 -- start start 2024-08-17T02:46:57.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.196+0000 7f2c0ca00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 0x7f2c000ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.197+0000 7f2c0ca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000552e0 0x7f2c00050430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.197+0000 7f2c05e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 0x7f2c000ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.197+0000 7f2c05e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 0x7f2c000ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52294/0 (socket says 172.21.15.149:52294) 2024-08-17T02:46:57.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.197+0000 7f2c05e00640 1 -- 172.21.15.149:0/2612964110 learned_addr learned my addr 172.21.15.149:0/2612964110 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.198+0000 7f2c05400640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000552e0 0x7f2c00050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.198+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c000e62c0 0x7f2c000eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.198+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00050970 con 0x7f2c000e62c0 2024-08-17T02:46:57.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.198+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c000ea760 con 0x7f2c000552e0 2024-08-17T02:46:57.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.198+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c000eaa40 con 0x7f2c000521d0 2024-08-17T02:46:57.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.199+0000 7f2c05400640 1 -- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 msgr2=0x7f2c000ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.200+0000 7f2c05400640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 0x7f2c000ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.200+0000 7f2c05400640 1 -- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c000e62c0 msgr2=0x7f2c000eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.200+0000 7f2c05400640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c000e62c0 0x7f2c000eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.200+0000 7f2c05400640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4009450 con 0x7f2c000552e0 2024-08-17T02:46:57.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.200+0000 7f2c05e00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 0x7f2c000ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:57.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.201+0000 7f2c05400640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000552e0 0x7f2c00050430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c08066580 tx=0x7f2c08064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.201+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0806f470 con 0x7f2c000552e0 2024-08-17T02:46:57.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.202+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0808f3b0 con 0x7f2c000552e0 2024-08-17T02:46:57.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.202+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c000ead20 con 0x7f2c000552e0 2024-08-17T02:46:57.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.202+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c000eb2e0 con 0x7f2c000552e0 2024-08-17T02:46:57.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.203+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0808f770 con 0x7f2c000552e0 2024-08-17T02:46:57.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.205+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2c0808fb60 con 0x7f2c000552e0 2024-08-17T02:46:57.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.207+0000 7f2bfd600640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2be80651d0 0x7f2be8067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.207+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c080f8e40 con 0x7f2c000552e0 2024-08-17T02:46:57.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.208+0000 7f2c05e00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2be80651d0 0x7f2be8067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.210+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be0005210 con 0x7f2c000552e0 2024-08-17T02:46:57.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.210+0000 7f2c05e00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2be80651d0 0x7f2be8067680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009210 tx=0x7f2bf4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.215+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2c08095080 con 0x7f2c000552e0 2024-08-17T02:46:57.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.251+0000 7f954ee00640 1 Processor -- start 2024-08-17T02:46:57.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.251+0000 7f954ee00640 1 -- start start 2024-08-17T02:46:57.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.254+0000 7f0bf3600640 1 Processor -- start 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.254+0000 7f954ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 0x7f95480adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.254+0000 7f954ee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95480af6e0 con 0x7f954813e730 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.255+0000 7f954ee00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95480acb40 con 0x7f954813e360 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.255+0000 7f953f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 0x7f95480adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.255+0000 7f953f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 0x7f95480adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52296/0 (socket says 172.21.15.149:52296) 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.255+0000 7f953f400640 1 -- 172.21.15.149:0/1096135216 learned_addr learned my addr 172.21.15.149:0/1096135216 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.256+0000 7f954ee00640 1 -- 172.21.15.149:0/1096135216 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95480ad6c0 con 0x7f954806a5e0 2024-08-17T02:46:57.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.254+0000 7f0bf3600640 1 -- start start 2024-08-17T02:46:57.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.256+0000 7f9547400640 1 -- 172.21.15.149:0/1096135216 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440637620 0 0) 0x7f95480acb40 con 0x7f954813e360 2024-08-17T02:46:57.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.256+0000 7f9547400640 1 -- 172.21.15.149:0/1096135216 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f952c0034e0 con 0x7f954813e360 2024-08-17T02:46:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.257+0000 7f953f400640 1 -- 172.21.15.149:0/1096135216 >> v1:172.21.15.161:6789/0 conn(0x7f954813e360 legacy=0x7f9548069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.257+0000 7f953f400640 1 -- 172.21.15.149:0/1096135216 >> v1:172.21.15.149:6789/0 conn(0x7f954813e730 legacy=0x7f95480aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.257+0000 7f0bf0c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0bec15d830 0x7f0bec06e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37990/0 (socket says 172.21.15.149:37990) 2024-08-17T02:46:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.257+0000 7f0bf0c00640 1 -- 172.21.15.149:0/4088482884 learned_addr learned my addr 172.21.15.149:0/4088482884 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.257+0000 7f953f400640 1 -- 172.21.15.149:0/1096135216 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480acd90 con 0x7f954806a5e0 2024-08-17T02:46:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.258+0000 7f0bf3600640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 0x7f0bec15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.258+0000 7f0bf3600640 1 --2- 172.21.15.149:0/4088482884 >> v2:172.21.15.161:3300/0 conn(0x7f0bec15e140 0x7f0bec166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.259+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec0b1690 con 0x7f0bec15d830 2024-08-17T02:46:57.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.259+0000 7f0bebe00640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 0x7f0bec15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.259+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322008499 0 0) 0x7f0bec0b1690 con 0x7f0bec15d830 2024-08-17T02:46:57.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.260+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec06e8c0 con 0x7f0bec15e140 2024-08-17T02:46:57.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.260+0000 7f953f400640 1 --2- 172.21.15.149:0/1096135216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 0x7f95480adb50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95300098c0 tx=0x7f95300091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d8f0bd21e91039 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.260+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0b1b20 con 0x7f0bec0b0610 2024-08-17T02:46:57.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.260+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd00034e0 con 0x7f0bec15d830 2024-08-17T02:46:57.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.260+0000 7f9547400640 1 -- 172.21.15.149:0/1096135216 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380017f0 con 0x7f954806a5e0 2024-08-17T02:46:57.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f9547400640 1 -- 172.21.15.149:0/1096135216 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953002ab30 con 0x7f954806a5e0 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276915562 0 0) 0x7f0bd00034e0 con 0x7f0bec15d830 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 msgr2=0x7f0bec15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 0x7f0bec15dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 >> v2:172.21.15.161:3300/0 conn(0x7f0bec15e140 msgr2=0x7f0bec166e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 --2- 172.21.15.149:0/4088482884 >> v2:172.21.15.161:3300/0 conn(0x7f0bec15e140 0x7f0bec166e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0ae4a0 con 0x7f0bec15d830 2024-08-17T02:46:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f9547400640 1 -- 172.21.15.149:0/1096135216 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530032440 con 0x7f954806a5e0 2024-08-17T02:46:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f0bd8001470 con 0x7f0bec15d830 2024-08-17T02:46:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 >> v1:172.21.15.149:6789/0 conn(0x7f0bec15d830 legacy=0x7f0bec06e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0003a80 0x7f0bd0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bd0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.261+0000 7f0beb400640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 0x7f0bd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.262+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec06e8c0 con 0x7f0bd0004780 2024-08-17T02:46:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.262+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0b1b20 con 0x7f0bd0003a80 2024-08-17T02:46:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.262+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd000bb90 con 0x7f0bec0b0610 2024-08-17T02:46:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.262+0000 7f954ee00640 1 -- 172.21.15.149:0/1096135216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 msgr2=0x7f95480adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.262+0000 7f954ee00640 1 --2- 172.21.15.149:0/1096135216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 0x7f95480adb50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95300098c0 tx=0x7f95300091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f954ee00640 1 -- 172.21.15.149:0/1096135216 shutdown_connections 2024-08-17T02:46:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f954ee00640 1 --2- 172.21.15.149:0/1096135216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954806a5e0 0x7f95480adb50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f954ee00640 1 -- 172.21.15.149:0/1096135216 >> 172.21.15.149:0/1096135216 conn(0x7f95480cc480 msgr2=0x7f95480687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f0bebe00640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bd0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f0bf1600640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 0x7f0bd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f954ee00640 1 -- 172.21.15.149:0/1096135216 shutdown_connections 2024-08-17T02:46:57.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.264+0000 7f954ee00640 1 -- 172.21.15.149:0/1096135216 wait complete. 2024-08-17T02:46:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.263+0000 7f0bebe00640 1 -- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 msgr2=0x7f0bd0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.264+0000 7f0bebe00640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec0b0610 0x7f0bd0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.264+0000 7f0bebe00640 1 -- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0003a80 msgr2=0x7f0bd0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.264+0000 7f0bebe00640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0003a80 0x7f0bd0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.264+0000 7f0bebe00640 1 -- 172.21.15.149:0/4088482884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00034e0 con 0x7f0bd0004780 2024-08-17T02:46:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.266+0000 7f0bebe00640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bd0004bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0ad8a0 tx=0x7f0be400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e391529d256f992 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.266+0000 7f954ee00640 1 Processor -- start 2024-08-17T02:46:57.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.267+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4031480 con 0x7f0bd0004780 2024-08-17T02:46:57.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.267+0000 7f954ee00640 1 -- start start 2024-08-17T02:46:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.267+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400f040 con 0x7f0bd0004780 2024-08-17T02:46:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.267+0000 7f0beb400640 1 -- 172.21.15.149:0/4088482884 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4031810 con 0x7f0bd0004780 2024-08-17T02:46:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.268+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 msgr2=0x7f0bd0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.268+0000 7f0bf3600640 1 --2- 172.21.15.149:0/4088482884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bd0004bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0ad8a0 tx=0x7f0be400b040 comp rx=0 tx=0).stop 2024-08-17T02:46:57.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.268+0000 7f0bf1600640 1 -- 172.21.15.149:0/4088482884 reap_dead start 2024-08-17T02:46:57.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.269+0000 7f954ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 0x7f95480a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.269+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 shutdown_connections 2024-08-17T02:46:57.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.269+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 >> 172.21.15.149:0/4088482884 conn(0x7f0bec0cb9b0 msgr2=0x7f0bec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.269+0000 7f954ee00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954813e360 0x7f9548157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 shutdown_connections 2024-08-17T02:46:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f9547e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 0x7f95480a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f0bf3600640 1 -- 172.21.15.149:0/4088482884 wait complete. 2024-08-17T02:46:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f954ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954813e730 0x7f9548167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f954ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548167730 con 0x7f954806a5e0 2024-08-17T02:46:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f954ee00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548166b20 con 0x7f954813e360 2024-08-17T02:46:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f954ee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9548166e00 con 0x7f954813e730 2024-08-17T02:46:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f9547e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 0x7f95480a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43992/0 (socket says 172.21.15.149:43992) 2024-08-17T02:46:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f9547e00640 1 -- 172.21.15.149:0/3267118078 learned_addr learned my addr 172.21.15.149:0/3267118078 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7fbc50c00640 1 Processor -- start 2024-08-17T02:46:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7fbc50c00640 1 -- start start 2024-08-17T02:46:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.270+0000 7f953f400640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954813e360 0x7f9548157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.271+0000 7f954ce00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954813e730 0x7f9548167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.271+0000 7f9547e00640 1 -- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954813e730 msgr2=0x7f9548167bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.271+0000 7f9547e00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954813e730 0x7f9548167bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.271+0000 7f9547e00640 1 -- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954813e360 msgr2=0x7f9548157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.271+0000 7f9547e00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954813e360 0x7f9548157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.271+0000 7f9547e00640 1 -- 172.21.15.149:0/3267118078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530009450 con 0x7f954806a5e0 2024-08-17T02:46:57.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.272+0000 7f91af200640 1 Processor -- start 2024-08-17T02:46:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.272+0000 7f91af200640 1 -- start start 2024-08-17T02:46:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7f0bf3600640 1 Processor -- start 2024-08-17T02:46:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7f0bf3600640 1 -- start start 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7fbc50c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 0x7fbc4c069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7fbc50c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc4c069a90 0x7fbc4c13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7fbc50c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbc4c13b420 0x7fbc4c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7fbc50c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c06afb0 con 0x7fbc4c13b420 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7fbc50c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c15bd30 con 0x7fbc4c069a90 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7fbc50c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c069f10 con 0x7fbc4c06e570 2024-08-17T02:46:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7f0c88c00640 1 Processor -- start 2024-08-17T02:46:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.273+0000 7f0c88c00640 1 -- start start 2024-08-17T02:46:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7fbc49e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 0x7fbc4c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7fbc49e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 0x7fbc4c069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52336/0 (socket says 172.21.15.149:52336) 2024-08-17T02:46:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7f9547e00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 0x7f95480a9ea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f953800c3a0 tx=0x7f9538007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7fbc49e00640 1 -- 172.21.15.149:0/2473851764 learned_addr learned my addr 172.21.15.149:0/2473851764 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538007260 con 0x7f954806a5e0 2024-08-17T02:46:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95481670e0 con 0x7f954806a5e0 2024-08-17T02:46:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9548166740 con 0x7f954806a5e0 2024-08-17T02:46:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7fbc4a800640 1 --2- 172.21.15.149:0/2473851764 >> v2:172.21.15.149:3300/0 conn(0x7fbc4c13b420 0x7fbc4c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0bf3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bec16d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0c88c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0c84155a20 0x7f0c840adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0bf3600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 0x7f0bec170a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0bf3600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bec170f70 0x7f0bec0a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0bf3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec171410 con 0x7f0bd0004780 2024-08-17T02:46:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0bf3600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec1603f0 con 0x7f0bec170f70 2024-08-17T02:46:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0bf3600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0a6b30 con 0x7f0bec1701e0 2024-08-17T02:46:57.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0c88c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c84155df0 0x7f0c840ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f91af200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f91a80e6220 0x7f91a803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f91af200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a803afe0 con 0x7f91a80eac50 2024-08-17T02:46:57.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f91af200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a803b2c0 con 0x7f91a8038e10 2024-08-17T02:46:57.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f91af200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a803b5a0 con 0x7f91a80e6220 2024-08-17T02:46:57.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0c88c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c8406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0c88c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840b0350 con 0x7f0c84155a20 2024-08-17T02:46:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0c88c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c84156670 con 0x7f0c84155df0 2024-08-17T02:46:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7f0c88c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8406e180 con 0x7f0c8406d7f0 2024-08-17T02:46:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.276+0000 7f0c81e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0c84155a20 0x7f0c840adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.276+0000 7f0c82800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c8406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.276+0000 7f0c82800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c8406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52360/0 (socket says 172.21.15.149:52360) 2024-08-17T02:46:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.276+0000 7f0c82800640 1 -- 172.21.15.149:0/4031446040 learned_addr learned my addr 172.21.15.149:0/4031446040 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.274+0000 7fbc49e00640 1 -- 172.21.15.149:0/2473851764 >> v2:172.21.15.161:3300/0 conn(0x7fbc4c069a90 msgr2=0x7fbc4c13aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7fbc49e00640 1 --2- 172.21.15.149:0/2473851764 >> v2:172.21.15.161:3300/0 conn(0x7fbc4c069a90 0x7fbc4c13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7fbc49e00640 1 -- 172.21.15.149:0/2473851764 >> v2:172.21.15.149:3300/0 conn(0x7fbc4c13b420 msgr2=0x7fbc4c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7fbc49e00640 1 --2- 172.21.15.149:0/2473851764 >> v2:172.21.15.149:3300/0 conn(0x7fbc4c13b420 0x7fbc4c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7fbc49e00640 1 -- 172.21.15.149:0/2473851764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c06a1f0 con 0x7fbc4c06e570 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.275+0000 7fbc4a800640 1 --2- 172.21.15.149:0/2473851764 >> v2:172.21.15.149:3300/0 conn(0x7fbc4c13b420 0x7fbc4c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7fbc49e00640 1 --2- 172.21.15.149:0/2473851764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 0x7fbc4c069550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0cc8b0 tx=0x7fbc3c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e416a9a187902a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f91ae800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f91a8038e10 0x7f91a80066f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:35416/0 (socket says 172.21.15.149:35416) 2024-08-17T02:46:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f91ae800640 1 -- 172.21.15.149:0/3130584521 learned_addr learned my addr 172.21.15.149:0/3130584521 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:57.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9538006530 con 0x7f954806a5e0 2024-08-17T02:46:57.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380066e0 con 0x7f954806a5e0 2024-08-17T02:46:57.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.276+0000 7f0bebe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 0x7f0bec170a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0bebe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 0x7f0bec170a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52348/0 (socket says 172.21.15.149:52348) 2024-08-17T02:46:57.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0bebe00640 1 -- 172.21.15.149:0/3836339516 learned_addr learned my addr 172.21.15.149:0/3836339516 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7fbc48a00640 1 -- 172.21.15.149:0/2473851764 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c02ae60 con 0x7fbc4c06e570 2024-08-17T02:46:57.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0c81e00640 1 -- 172.21.15.149:0/4031446040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 msgr2=0x7f0c8406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0c81e00640 1 --2- 172.21.15.149:0/4031446040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c8406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0c81e00640 1 -- 172.21.15.149:0/4031446040 >> v2:172.21.15.161:3300/0 conn(0x7f0c84155df0 msgr2=0x7f0c840ad9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:57.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0c81e00640 1 --2- 172.21.15.149:0/4031446040 >> v2:172.21.15.161:3300/0 conn(0x7f0c84155df0 0x7f0c840ad9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7fbc48a00640 1 -- 172.21.15.149:0/2473851764 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c032440 con 0x7fbc4c06e570 2024-08-17T02:46:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7fbc48a00640 1 -- 172.21.15.149:0/2473851764 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0327e0 con 0x7fbc4c06e570 2024-08-17T02:46:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.277+0000 7f0c81e00640 1 -- 172.21.15.149:0/4031446040 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8406e5e0 con 0x7f0c84155a20 2024-08-17T02:46:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228944634 0 0) 0x7f91a803b2c0 con 0x7f91a8038e10 2024-08-17T02:46:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91940034e0 con 0x7f91a8038e10 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f0bf1600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bec170f70 0x7f0bec0a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f0bebe00640 1 -- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bec170f70 msgr2=0x7f0bec0a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f0bebe00640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bec170f70 0x7f0bec0a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f0bebe00640 1 -- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 msgr2=0x7f0bec16d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f0bebe00640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bec16d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f0bebe00640 1 -- 172.21.15.149:0/3836339516 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec15fb00 con 0x7f0bec1701e0 2024-08-17T02:46:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 355163300 0 0) 0x7f91940034e0 con 0x7f91a8038e10 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 >> v2:172.21.15.161:3300/0 conn(0x7f91a80e6220 msgr2=0x7f91a803a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 --2- 172.21.15.149:0/3130584521 >> v2:172.21.15.161:3300/0 conn(0x7f91a80e6220 0x7f91a803a6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 >> v1:172.21.15.149:6789/0 conn(0x7f91a80eac50 legacy=0x7f91a8038700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a803b880 con 0x7f91a8038e10 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f91b0065e30 con 0x7f91a8038e10 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 >> v1:172.21.15.161:6789/0 conn(0x7f91a8038e10 legacy=0x7f91a80066f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9194003a50 0x7f9194003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9194004780 0x7f9194004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9194005280 0x7f919400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a803b5a0 con 0x7f9194003a50 2024-08-17T02:46:57.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919400c1a0 con 0x7f9194004780 2024-08-17T02:46:57.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.278+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919400c360 con 0x7f9194005280 2024-08-17T02:46:57.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 -- 172.21.15.149:0/2473851764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 msgr2=0x7fbc4c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 --2- 172.21.15.149:0/2473851764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 0x7fbc4c069550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0cc8b0 tx=0x7fbc3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f91ad400640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9194004780 0x7f9194004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 -- 172.21.15.149:0/2473851764 shutdown_connections 2024-08-17T02:46:57.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 --2- 172.21.15.149:0/2473851764 >> v2:172.21.15.149:3300/0 conn(0x7fbc4c13b420 0x7fbc4c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 --2- 172.21.15.149:0/2473851764 >> v2:172.21.15.161:3300/0 conn(0x7fbc4c069a90 0x7fbc4c13aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 --2- 172.21.15.149:0/2473851764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c06e570 0x7fbc4c069550 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0cc8b0 tx=0x7fbc3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f0c81e00640 1 --2- 172.21.15.149:0/4031446040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c840adf10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c8406aa10 tx=0x7f0c740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219897504b8a52e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 -- 172.21.15.149:0/2473851764 >> 172.21.15.149:0/2473851764 conn(0x7fbc4c0cb7a0 msgr2=0x7fbc4c0cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7fbc50c00640 1 -- 172.21.15.149:0/2473851764 shutdown_connections 2024-08-17T02:46:57.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0bebe00640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 0x7f0bec170a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0be402af10 tx=0x7f0be4036000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0c81400640 1 -- 172.21.15.149:0/4031446040 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7402ad20 con 0x7f0c84155a20 2024-08-17T02:46:57.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0c81400640 1 -- 172.21.15.149:0/4031446040 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7402ae80 con 0x7f0c84155a20 2024-08-17T02:46:57.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0c81400640 1 -- 172.21.15.149:0/4031446040 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74032670 con 0x7f0c84155a20 2024-08-17T02:46:57.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40307c0 con 0x7f0bec1701e0 2024-08-17T02:46:57.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4030920 con 0x7f0bec1701e0 2024-08-17T02:46:57.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4030ce0 con 0x7f0bec1701e0 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec15fda0 con 0x7f0bec1701e0 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec16d9f0 con 0x7f0bec1701e0 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7fbc50c00640 1 -- 172.21.15.149:0/2473851764 wait complete. 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.279+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9538006840 con 0x7f954806a5e0 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9520005210 con 0x7f954806a5e0 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f953fe00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9524065200 0x7f95240676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9538084670 con 0x7f954806a5e0 2024-08-17T02:46:57.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f0c88c00640 1 -- 172.21.15.149:0/4031446040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 msgr2=0x7f0c840adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f0c88c00640 1 --2- 172.21.15.149:0/4031446040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c840adf10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c8406aa10 tx=0x7f0c740090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.282+0000 7f953f400640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9524065200 0x7f95240676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f91ad400640 1 -- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9194005280 msgr2=0x7f919400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f91ad400640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9194005280 0x7f919400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.280+0000 7f91ad400640 1 -- 172.21.15.149:0/3130584521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9194003a50 msgr2=0x7f9194003e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f91ad400640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9194003a50 0x7f9194003e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f91ad400640 1 -- 172.21.15.149:0/3130584521 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a803b880 con 0x7f9194004780 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.281+0000 7f91ae800640 1 -- 172.21.15.149:0/3130584521 reap_dead start 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.282+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec064db0 con 0x7f0bec1701e0 2024-08-17T02:46:57.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.283+0000 7f953f400640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9524065200 0x7f95240676b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9530034000 tx=0x7f9530032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.283+0000 7f0c88c00640 1 -- 172.21.15.149:0/4031446040 shutdown_connections 2024-08-17T02:46:57.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.283+0000 7f0c88c00640 1 --2- 172.21.15.149:0/4031446040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c8406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.283+0000 7f0c88c00640 1 --2- 172.21.15.149:0/4031446040 >> v2:172.21.15.161:3300/0 conn(0x7f0c84155df0 0x7f0c840ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.283+0000 7f0c88c00640 1 --2- 172.21.15.149:0/4031446040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c840adf10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.283+0000 7f0c88c00640 1 -- 172.21.15.149:0/4031446040 >> 172.21.15.149:0/4031446040 conn(0x7f0c840cb9b0 msgr2=0x7f0c840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.284+0000 7f0c88c00640 1 -- 172.21.15.149:0/4031446040 shutdown_connections 2024-08-17T02:46:57.304 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.284+0000 7f91ad400640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9194004780 0x7f9194004bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f919c001800 tx=0x7f919c007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22d473aac8d50f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.304 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.284+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c02a8e0 con 0x7f9194004780 2024-08-17T02:46:57.304 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.285+0000 7fbc50c00640 1 Processor -- start 2024-08-17T02:46:57.304 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.284+0000 7f0c88c00640 1 -- 172.21.15.149:0/4031446040 wait complete. 2024-08-17T02:46:57.304 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.285+0000 7fbc50c00640 1 -- start start 2024-08-17T02:46:57.305 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.285+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0be4043070 con 0x7f0bec1701e0 2024-08-17T02:46:57.305 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.284+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c02aa60 con 0x7f9194004780 2024-08-17T02:46:57.305 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.284+0000 7f91aca00640 1 -- 172.21.15.149:0/3130584521 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c02ae20 con 0x7f9194004780 2024-08-17T02:46:57.305 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.286+0000 7f0c88c00640 1 Processor -- start 2024-08-17T02:46:57.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.286+0000 7f0be3e00640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0bcc065220 0x7f0bcc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.286+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0be40a4210 con 0x7f0bec1701e0 2024-08-17T02:46:57.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.286+0000 7f91af200640 1 -- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9194004780 msgr2=0x7f9194004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.286+0000 7f91af200640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9194004780 0x7f9194004bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f919c001800 tx=0x7f919c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7f91af200640 1 -- 172.21.15.149:0/3130584521 shutdown_connections 2024-08-17T02:46:57.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7f91af200640 1 --2- 172.21.15.149:0/3130584521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9194004780 0x7f9194004bf0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f919c001800 tx=0x7f919c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7f91af200640 1 -- 172.21.15.149:0/3130584521 >> 172.21.15.149:0/3130584521 conn(0x7f91a800f050 msgr2=0x7f91a8058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7f0c88c00640 1 -- start start 2024-08-17T02:46:57.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7f91af200640 1 -- 172.21.15.149:0/3130584521 shutdown_connections 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc50c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc4c13b420 0x7fbc4c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc50c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 0x7fbc4c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc50c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc4c13a600 0x7fbc4c14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc50c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c12e4d0 con 0x7fbc4c13b420 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc50c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c13d0a0 con 0x7fbc4c13a600 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc50c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c14f560 con 0x7fbc4c132600 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc49400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 0x7fbc4c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc49400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 0x7fbc4c13a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52382/0 (socket says 172.21.15.149:52382) 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.287+0000 7fbc49400640 1 -- 172.21.15.149:0/3602254940 learned_addr learned my addr 172.21.15.149:0/3602254940 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0c88c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c840a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0c88c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c84165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0c88c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 0x7f0c84140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0c88c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840a8340 con 0x7f0c84155a20 2024-08-17T02:46:57.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0c88c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840a8620 con 0x7f0c84155df0 2024-08-17T02:46:57.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0c88c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840a8900 con 0x7f0c8406d7f0 2024-08-17T02:46:57.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f0bf0c00640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0bcc065220 0x7f0bcc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 0x7f0c84140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 0x7f0c84140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:58154/0 (socket says 172.21.15.149:58154) 2024-08-17T02:46:57.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 -- 172.21.15.149:0/2627916781 learned_addr learned my addr 172.21.15.149:0/2627916781 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c7be00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c84165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9538052690 con 0x7f954806a5e0 2024-08-17T02:46:57.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7fbc49e00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc4c13b420 0x7fbc4c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7fbc4a800640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc4c13a600 0x7fbc4c14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.288+0000 7f91af200640 1 -- 172.21.15.149:0/3130584521 wait complete. 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c81e00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c840a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 -- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 msgr2=0x7f0c840a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c840a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 -- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 msgr2=0x7f0c84165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c84165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.289+0000 7f0c82800640 1 -- 172.21.15.149:0/2627916781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74009390 con 0x7f0c84155df0 2024-08-17T02:46:57.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.290+0000 7f0bf0c00640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0bcc065220 0x7f0bcc0676d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007c10 tx=0x7f0bd8001a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc49400640 1 -- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc4c13a600 msgr2=0x7fbc4c14bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc49400640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc4c13a600 0x7fbc4c14bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7f0c82800640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 0x7f0c84140000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00bee0 tx=0x7f0c7c00b2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7f91af200640 1 Processor -- start 2024-08-17T02:46:57.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0be4072350 con 0x7f0bec1701e0 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc49400640 1 -- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc4c13b420 msgr2=0x7fbc4c14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc49400640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc4c13b420 0x7fbc4c14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc49400640 1 -- 172.21.15.149:0/3602254940 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44009a20 con 0x7fbc4c132600 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc49e00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc4c13b420 0x7fbc4c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7fbc4a800640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc4c13a600 0x7fbc4c14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00fd50 con 0x7f0c84155df0 2024-08-17T02:46:57.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c014550 con 0x7f0c84155df0 2024-08-17T02:46:57.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.291+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c014910 con 0x7f0c84155df0 2024-08-17T02:46:57.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.292+0000 7fbc49400640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 0x7fbc4c13a0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800b810 tx=0x7fbc380091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.292+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800be60 con 0x7fbc4c132600 2024-08-17T02:46:57.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.292+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3800c730 con 0x7fbc4c132600 2024-08-17T02:46:57.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.292+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800be60 con 0x7fbc4c132600 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.293+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c009450 con 0x7fbc4c132600 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.293+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c13ca50 con 0x7fbc4c132600 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.293+0000 7f91af200640 1 -- start start 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f91af200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a80e3830 0x7f91a803c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f91af200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a80514d0 0x7f91a8054c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f91af200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a8055140 0x7f91a804ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f91af200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a80555b0 con 0x7f91a80e3830 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f91af200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a80527e0 con 0x7f91a8055140 2024-08-17T02:46:57.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f91af200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8051940 con 0x7f91a80514d0 2024-08-17T02:46:57.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840a8be0 con 0x7f0c84155df0 2024-08-17T02:46:57.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.294+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c84140540 con 0x7f0c84155df0 2024-08-17T02:46:57.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.295+0000 7f91ad400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a80514d0 0x7f91a8054c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.295+0000 7f91ad400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a80514d0 0x7f91a8054c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52406/0 (socket says 172.21.15.149:52406) 2024-08-17T02:46:57.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.295+0000 7f91ad400640 1 -- 172.21.15.149:0/1249244706 learned_addr learned my addr 172.21.15.149:0/1249244706 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.296+0000 7f91ade00640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a80e3830 0x7f91a803c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.295+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c13d210 con 0x7fbc4c132600 2024-08-17T02:46:57.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.297+0000 7f91ade00640 1 -- 172.21.15.149:0/1249244706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a80514d0 msgr2=0x7f91a8054c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.297+0000 7f91ade00640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a80514d0 0x7f91a8054c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.297+0000 7f91ade00640 1 -- 172.21.15.149:0/1249244706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a8055140 msgr2=0x7f91a804ff80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.297+0000 7f91ade00640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a8055140 0x7f91a804ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.297+0000 7f91ade00640 1 -- 172.21.15.149:0/1249244706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a80e3c00 con 0x7f91a80e3830 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.298+0000 7f91ade00640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a80e3830 0x7f91a803c700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91a8059fe0 tx=0x7f91a0006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.298+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc38012070 con 0x7fbc4c132600 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.296+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c84064db0 con 0x7f0c84155df0 2024-08-17T02:46:57.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.299+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0c7c014cc0 con 0x7f0c84155df0 2024-08-17T02:46:57.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.298+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000ba20 con 0x7f91a80e3830 2024-08-17T02:46:57.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.299+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000bba0 con 0x7f91a80e3830 2024-08-17T02:46:57.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.299+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0011400 con 0x7f91a80e3830 2024-08-17T02:46:57.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.300+0000 7fbc41600640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc2c0651b0 0x7fbc2c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.300+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc380816c0 con 0x7fbc4c132600 2024-08-17T02:46:57.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.301+0000 7fbc49e00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc2c0651b0 0x7fbc2c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.300+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a8051bd0 con 0x7f91a80e3830 2024-08-17T02:46:57.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.300+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a8052190 con 0x7f91a80e3830 2024-08-17T02:46:57.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.300+0000 7f0c79600640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0c600652a0 0x7f0c60067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.300+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c7c086710 con 0x7f0c84155df0 2024-08-17T02:46:57.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.301+0000 7f0c81e00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0c600652a0 0x7f0c60067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.302+0000 7f0c81e00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0c600652a0 0x7f0c60067750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c74034000 tx=0x7f0c74032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.302+0000 7fbc49e00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc2c0651b0 0x7fbc2c067660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c034000 tx=0x7fbc3c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.304+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0c7c0547b0 con 0x7f0c84155df0 2024-08-17T02:46:57.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.304+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f91a00117f0 con 0x7f91a80e3830 2024-08-17T02:46:57.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.304+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc3804f780 con 0x7fbc4c132600 2024-08-17T02:46:57.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.304+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a8053510 con 0x7f91a80e3830 2024-08-17T02:46:57.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.306+0000 7f91a5600640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9190065150 0x7f9190067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.306+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91a00538a0 con 0x7f91a80e3830 2024-08-17T02:46:57.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.308+0000 7f91ad400640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9190065150 0x7f9190067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.312+0000 7f91ad400640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9190065150 0x7f9190067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f919c02a6d0 tx=0x7f919c003000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.317+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91a004fc70 con 0x7f91a80e3830 2024-08-17T02:46:57.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.335+0000 7f9304800640 1 Processor -- start 2024-08-17T02:46:57.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.336+0000 7f9304800640 1 -- start start 2024-08-17T02:46:57.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.338+0000 7f9304800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.339+0000 7f9304800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0af6e0 con 0x7f92fc06a5e0 2024-08-17T02:46:57.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.339+0000 7f9304800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0acb40 con 0x7f92fc13e730 2024-08-17T02:46:57.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.339+0000 7f9304800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0ad6c0 con 0x7f92fc13e360 2024-08-17T02:46:57.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.339+0000 7f9301e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.339+0000 7f9301e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc0adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52414/0 (socket says 172.21.15.149:52414) 2024-08-17T02:46:57.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.340+0000 7f9301e00640 1 -- 172.21.15.149:0/1128920073 learned_addr learned my addr 172.21.15.149:0/1128920073 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.341+0000 7f9300a00640 1 -- 172.21.15.149:0/1128920073 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035949563 0 0) 0x7f92fc0acb40 con 0x7f92fc13e730 2024-08-17T02:46:57.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.341+0000 7f9300a00640 1 -- 172.21.15.149:0/1128920073 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e40034e0 con 0x7f92fc13e730 2024-08-17T02:46:57.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.341+0000 7f9300a00640 1 -- 172.21.15.149:0/1128920073 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389602013 0 0) 0x7f92fc0af6e0 con 0x7f92fc06a5e0 2024-08-17T02:46:57.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.341+0000 7f9301e00640 1 -- 172.21.15.149:0/1128920073 >> v1:172.21.15.161:6789/0 conn(0x7f92fc13e730 legacy=0x7f92fc069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.341+0000 7f9301e00640 1 -- 172.21.15.149:0/1128920073 >> v1:172.21.15.149:6789/0 conn(0x7f92fc06a5e0 legacy=0x7f92fc0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.341+0000 7f9301e00640 1 -- 172.21.15.149:0/1128920073 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0acd90 con 0x7f92fc13e360 2024-08-17T02:46:57.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.342+0000 7f9301e00640 1 --2- 172.21.15.149:0/1128920073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc0adb50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009940 tx=0x7f92ec0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46f04590f50e9e47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.343+0000 7f9300a00640 1 -- 172.21.15.149:0/1128920073 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec032440 con 0x7f92fc13e360 2024-08-17T02:46:57.344 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.343+0000 7f9300a00640 1 -- 172.21.15.149:0/1128920073 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0325a0 con 0x7f92fc13e360 2024-08-17T02:46:57.344 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.344+0000 7f9304800640 1 -- 172.21.15.149:0/1128920073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 msgr2=0x7f92fc0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.344 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.344+0000 7f9304800640 1 --2- 172.21.15.149:0/1128920073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc0adb50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009940 tx=0x7f92ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.344+0000 7f9304800640 1 -- 172.21.15.149:0/1128920073 shutdown_connections 2024-08-17T02:46:57.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.345+0000 7f9304800640 1 --2- 172.21.15.149:0/1128920073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc0adb50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.345+0000 7f9304800640 1 -- 172.21.15.149:0/1128920073 >> 172.21.15.149:0/1128920073 conn(0x7f92fc0cc480 msgr2=0x7f92fc0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.345+0000 7f9304800640 1 -- 172.21.15.149:0/1128920073 shutdown_connections 2024-08-17T02:46:57.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.345+0000 7f9304800640 1 -- 172.21.15.149:0/1128920073 wait complete. 2024-08-17T02:46:57.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.348+0000 7f9304800640 1 Processor -- start 2024-08-17T02:46:57.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.348+0000 7f9304800640 1 -- start start 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.350+0000 7f9304800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92fc06a5e0 0x7f92fc175120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.350+0000 7f9304800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.350+0000 7f9304800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92fc13e730 0x7f92fc1394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9304800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc15a440 con 0x7f92fc13e730 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9304800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc159b50 con 0x7f92fc06a5e0 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9304800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc159df0 con 0x7f92fc13e360 2024-08-17T02:46:57.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9302800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92fc13e730 0x7f92fc1394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92fc06a5e0 0x7f92fc175120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92fc06a5e0 0x7f92fc175120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:58182/0 (socket says 172.21.15.149:58182) 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301e00640 1 -- 172.21.15.149:0/2346368745 learned_addr learned my addr 172.21.15.149:0/2346368745 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301400640 1 -- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92fc06a5e0 msgr2=0x7f92fc175120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301400640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92fc06a5e0 0x7f92fc175120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.351+0000 7f9301400640 1 -- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92fc13e730 msgr2=0x7f92fc1394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.352+0000 7f9301400640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92fc13e730 0x7f92fc1394f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.352+0000 7f9301400640 1 -- 172.21.15.149:0/2346368745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec009450 con 0x7f92fc13e360 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.352+0000 7f9302800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92fc13e730 0x7f92fc1394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.352+0000 7f8484a00640 1 Processor -- start 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.352+0000 7f8484a00640 1 -- start start 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.353+0000 7f9301400640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc138fb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c3f0 tx=0x7f92f0007ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.353+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0013480 con 0x7f92fc13e360 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f8484a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8480158c80 0x7f84800ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f8484a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84800cd700 0x7f84800cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f8484a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84800cf9d0 con 0x7f84800cc800 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f8484a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800ceb60 con 0x7f8480158c80 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f8484a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800cedc0 con 0x7f84800cd700 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.353+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f00135e0 con 0x7f92fc13e360 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.353+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00139e0 con 0x7f92fc13e360 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc15a0d0 con 0x7f92fc13e360 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc136d50 con 0x7f92fc13e360 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.354+0000 7f847ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84800cd700 0x7f84800cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8480158c80 0x7f84800ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84800cd700 0x7f84800cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:58194/0 (socket says 172.21.15.149:58194) 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847ea00640 1 -- 172.21.15.149:0/383412869 learned_addr learned my addr 172.21.15.149:0/383412869 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847ea00640 1 -- 172.21.15.149:0/383412869 >> v2:172.21.15.149:3300/0 conn(0x7f8480158c80 msgr2=0x7f84800ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847ea00640 1 --2- 172.21.15.149:0/383412869 >> v2:172.21.15.149:3300/0 conn(0x7f8480158c80 0x7f84800ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847ea00640 1 -- 172.21.15.149:0/383412869 >> v1:172.21.15.161:6789/0 conn(0x7f84800cc800 legacy=0x7f84800ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.355+0000 7f847ea00640 1 -- 172.21.15.149:0/383412869 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800cf0a0 con 0x7f84800cd700 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.357+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc15a260 con 0x7f92fc13e360 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.357+0000 7f847f400640 1 --2- 172.21.15.149:0/383412869 >> v2:172.21.15.149:3300/0 conn(0x7f8480158c80 0x7f84800ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.357+0000 7f847ea00640 1 --2- 172.21.15.149:0/383412869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cd700 0x7f84800cc2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84800b2720 tx=0x7f8470009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee5ec5b766c481 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.357+0000 7f847e000640 1 -- 172.21.15.149:0/383412869 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470031400 con 0x7f84800cd700 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.358+0000 7f847e000640 1 -- 172.21.15.149:0/383412869 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847002d050 con 0x7f84800cd700 2024-08-17T02:46:57.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.358+0000 7f847e000640 1 -- 172.21.15.149:0/383412869 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700317b0 con 0x7f84800cd700 2024-08-17T02:46:57.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.360+0000 7f8484a00640 1 -- 172.21.15.149:0/383412869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cd700 msgr2=0x7f84800cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.360+0000 7f8484a00640 1 --2- 172.21.15.149:0/383412869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cd700 0x7f84800cc2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84800b2720 tx=0x7f8470009840 comp rx=0 tx=0).stop 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.359+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f92f00123e0 con 0x7f92fc13e360 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.361+0000 7f92f5600640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92e0065180 0x7f92e0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.361+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92f0081dc0 con 0x7f92fc13e360 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.362+0000 7f9301e00640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92e0065180 0x7f92e0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.363+0000 7f8484a00640 1 -- 172.21.15.149:0/383412869 shutdown_connections 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.363+0000 7f8484a00640 1 --2- 172.21.15.149:0/383412869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cd700 0x7f84800cc2c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.363+0000 7f8484a00640 1 --2- 172.21.15.149:0/383412869 >> v2:172.21.15.149:3300/0 conn(0x7f8480158c80 0x7f84800ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.363+0000 7f8484a00640 1 -- 172.21.15.149:0/383412869 >> 172.21.15.149:0/383412869 conn(0x7f8480098e30 msgr2=0x7f848006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.364+0000 7f9301e00640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92e0065180 0x7f92e0067630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92ec006d90 tx=0x7f92ec032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.364+0000 7f8484a00640 1 -- 172.21.15.149:0/383412869 shutdown_connections 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.364+0000 7f8484a00640 1 -- 172.21.15.149:0/383412869 wait complete. 2024-08-17T02:46:57.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.365+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92f004fe90 con 0x7f92fc13e360 2024-08-17T02:46:57.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.366+0000 7f8484a00640 1 Processor -- start 2024-08-17T02:46:57.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.366+0000 7f8484a00640 1 -- start start 2024-08-17T02:46:57.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.368+0000 7f8484a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 0x7f84800c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.368+0000 7f8484a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84800cd700 0x7f84800b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.368+0000 7f8484a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8480158c80 0x7f84800b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.368+0000 7f8484a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c8730 con 0x7f8480158c80 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.368+0000 7f8484a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848015a1d0 con 0x7f84800cc800 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.368+0000 7f8484a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84801595c0 con 0x7f84800cd700 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.369+0000 7f847f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 0x7f84800c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.369+0000 7f847f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 0x7f84800c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:58210/0 (socket says 172.21.15.149:58210) 2024-08-17T02:46:57.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.369+0000 7f847f400640 1 -- 172.21.15.149:0/3990913353 learned_addr learned my addr 172.21.15.149:0/3990913353 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:57.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.369+0000 7f847ea00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84800cd700 0x7f84800b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.370+0000 7f847fe00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8480158c80 0x7f84800b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.370+0000 7f847f400640 1 -- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84800cd700 msgr2=0x7f84800b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.370+0000 7f847f400640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84800cd700 0x7f84800b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.370+0000 7f847f400640 1 -- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8480158c80 msgr2=0x7f84800b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.370+0000 7f847f400640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8480158c80 0x7f84800b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.371+0000 7f847f400640 1 -- 172.21.15.149:0/3990913353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478013a10 con 0x7f84800cc800 2024-08-17T02:46:57.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.371+0000 7f847ea00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84800cd700 0x7f84800b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:57.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.371+0000 7f847fe00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8480158c80 0x7f84800b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:57.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.372+0000 7f847f400640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 0x7f84800c89c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8478017480 tx=0x7f8478008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.372+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478013e10 con 0x7f84800cc800 2024-08-17T02:46:57.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.372+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478019040 con 0x7f84800cc800 2024-08-17T02:46:57.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.372+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8470009ae0 con 0x7f84800cc800 2024-08-17T02:46:57.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.372+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847801c790 con 0x7f84800cc800 2024-08-17T02:46:57.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.376+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f847801cb40 con 0x7f84800cc800 2024-08-17T02:46:57.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.376+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8480159b80 con 0x7f84800cc800 2024-08-17T02:46:57.378 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.377+0000 7f8476a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f845c065150 0x7f845c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.378 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.378+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8480071050 con 0x7f84800cc800 2024-08-17T02:46:57.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.378+0000 7f847ea00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f845c065150 0x7f845c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.380+0000 7f847ea00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f845c065150 0x7f845c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8470033000 tx=0x7f8470036000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.380+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f847805ca90 con 0x7f84800cc800 2024-08-17T02:46:57.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.383+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8478024030 con 0x7f84800cc800 2024-08-17T02:46:57.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.615+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2be00054c0 con 0x7f2c000552e0 2024-08-17T02:46:57.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.616+0000 7f2bfd600640 1 -- 172.21.15.149:0/2612964110 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c0808b020 con 0x7f2c000552e0 2024-08-17T02:46:57.620 INFO:teuthology.orchestra.run.smithi149.stdout:60129542152 2024-08-17T02:46:57.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.622+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2be80651d0 msgr2=0x7f2be8067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.622+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2be80651d0 0x7f2be8067680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009210 tx=0x7f2bf4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.622+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000552e0 msgr2=0x7f2c00050430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.622+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000552e0 0x7f2c00050430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c08066580 tx=0x7f2c08064990 comp rx=0 tx=0).stop 2024-08-17T02:46:57.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 shutdown_connections 2024-08-17T02:46:57.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2be80651d0 0x7f2be8067680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c000e62c0 0x7f2c000eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c000552e0 0x7f2c00050430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 --2- 172.21.15.149:0/2612964110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c000521d0 0x7f2c000ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 >> 172.21.15.149:0/2612964110 conn(0x7f2c00057870 msgr2=0x7f2c000e6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 shutdown_connections 2024-08-17T02:46:57.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.624+0000 7f2c0ca00640 1 -- 172.21.15.149:0/2612964110 wait complete. 2024-08-17T02:46:57.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-08-17T02:46:57.652 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.678+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbc4c0aaab0 con 0x7fbc4c132600 2024-08-17T02:46:57.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.678+0000 7fbc41600640 1 -- 172.21.15.149:0/3602254940 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc3801a020 con 0x7fbc4c132600 2024-08-17T02:46:57.679 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:57.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc2c0651b0 msgr2=0x7fbc2c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc2c0651b0 0x7fbc2c067660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c034000 tx=0x7fbc3c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 msgr2=0x7fbc4c13a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 0x7fbc4c13a0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800b810 tx=0x7fbc380091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 shutdown_connections 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbc2c0651b0 0x7fbc2c067660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc4c13a600 0x7fbc4c14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc4c132600 0x7fbc4c13a0c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 --2- 172.21.15.149:0/3602254940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc4c13b420 0x7fbc4c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 >> 172.21.15.149:0/3602254940 conn(0x7fbc4c0cb7a0 msgr2=0x7fbc4c0ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 shutdown_connections 2024-08-17T02:46:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.681+0000 7fbc50c00640 1 -- 172.21.15.149:0/3602254940 wait complete. 2024-08-17T02:46:57.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.691+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0bec160560 con 0x7f0bec1701e0 2024-08-17T02:46:57.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.691+0000 7f0be3e00640 1 -- 172.21.15.149:0/3836339516 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0be4075970 con 0x7f0bec1701e0 2024-08-17T02:46:57.693 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0bcc065220 msgr2=0x7f0bcc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0bcc065220 0x7f0bcc0676d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007c10 tx=0x7f0bd8001a40 comp rx=0 tx=0).stop 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 msgr2=0x7f0bec170a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 0x7f0bec170a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0be402af10 tx=0x7f0be4036000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 shutdown_connections 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0bcc065220 0x7f0bcc0676d0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007c10 tx=0x7f0bd8001a40 comp rx=0 tx=0).stop 2024-08-17T02:46:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bec170f70 0x7f0bec0a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bec1701e0 0x7f0bec170a30 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0be402af10 tx=0x7f0be4036000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 --2- 172.21.15.149:0/3836339516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd0004780 0x7f0bec16d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.695+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 >> 172.21.15.149:0/3836339516 conn(0x7f0bec0cb9b0 msgr2=0x7f0bec06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.696+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 shutdown_connections 2024-08-17T02:46:57.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.696+0000 7f0bf3600640 1 -- 172.21.15.149:0/3836339516 wait complete. 2024-08-17T02:46:57.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-08-17T02:46:57.699 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.706+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f95200054c0 con 0x7f954806a5e0 2024-08-17T02:46:57.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.706+0000 7f953fe00640 1 -- 172.21.15.149:0/3267118078 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9538055cb0 con 0x7f954806a5e0 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9524065200 msgr2=0x7f95240676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9524065200 0x7f95240676b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9530034000 tx=0x7f9530032000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 msgr2=0x7f95480a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 0x7f95480a9ea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f953800c3a0 tx=0x7f9538007860 comp rx=0 tx=0).stop 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 shutdown_connections 2024-08-17T02:46:57.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9524065200 0x7f95240676b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f954813e730 0x7f9548167bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f954813e360 0x7f9548157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 --2- 172.21.15.149:0/3267118078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f954806a5e0 0x7f95480a9ea0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f953800c3a0 tx=0x7f9538007860 comp rx=0 tx=0).stop 2024-08-17T02:46:57.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 >> 172.21.15.149:0/3267118078 conn(0x7f95480cc480 msgr2=0x7f95481545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0c841543d0 con 0x7f0c84155df0 2024-08-17T02:46:57.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.710+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 shutdown_connections 2024-08-17T02:46:57.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.711+0000 7f954ee00640 1 -- 172.21.15.149:0/3267118078 wait complete. 2024-08-17T02:46:57.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.711+0000 7f0c79600640 1 -- 172.21.15.149:0/2627916781 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c7c057dd0 con 0x7f0c84155df0 2024-08-17T02:46:57.713 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0c600652a0 msgr2=0x7f0c60067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0c600652a0 0x7f0c60067750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c74034000 tx=0x7f0c74032000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 msgr2=0x7f0c84140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 0x7f0c84140000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00bee0 tx=0x7f0c7c00b2f0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 shutdown_connections 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0c600652a0 0x7f0c60067750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c84155df0 0x7f0c84140000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c84155a20 0x7f0c84165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 --2- 172.21.15.149:0/2627916781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8406d7f0 0x7f0c840a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 >> 172.21.15.149:0/2627916781 conn(0x7f0c840cb9b0 msgr2=0x7f0c841583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 shutdown_connections 2024-08-17T02:46:57.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.715+0000 7f0c88c00640 1 -- 172.21.15.149:0/2627916781 wait complete. 2024-08-17T02:46:57.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.717+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f91a8007380 con 0x7f91a80e3830 2024-08-17T02:46:57.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.717+0000 7f91a5600640 1 -- 172.21.15.149:0/1249244706 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91a004fe10 con 0x7f91a80e3830 2024-08-17T02:46:57.718 INFO:teuthology.orchestra.run.smithi149.stdout:64424509448 2024-08-17T02:46:57.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-08-17T02:46:57.722 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9190065150 msgr2=0x7f9190067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9190065150 0x7f9190067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f919c02a6d0 tx=0x7f919c003000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a80e3830 msgr2=0x7f91a803c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a80e3830 0x7f91a803c700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91a8059fe0 tx=0x7f91a0006f50 comp rx=0 tx=0).stop 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 shutdown_connections 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9190065150 0x7f9190067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a8055140 0x7f91a804ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a80514d0 0x7f91a8054c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 --2- 172.21.15.149:0/1249244706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a80e3830 0x7f91a803c700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.721+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 >> 172.21.15.149:0/1249244706 conn(0x7f91a800f050 msgr2=0x7f91a80065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.722+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 shutdown_connections 2024-08-17T02:46:57.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.722+0000 7f91af200640 1 -- 172.21.15.149:0/1249244706 wait complete. 2024-08-17T02:46:57.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-08-17T02:46:57.736 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-08-17T02:46:57.739 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-08-17T02:46:57.740 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.784+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f92fc15a5b0 con 0x7f92fc13e360 2024-08-17T02:46:57.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.784+0000 7f92f5600640 1 -- 172.21.15.149:0/2346368745 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92f0018090 con 0x7f92fc13e360 2024-08-17T02:46:57.785 INFO:teuthology.orchestra.run.smithi149.stdout:64424509447 2024-08-17T02:46:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92e0065180 msgr2=0x7f92e0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92e0065180 0x7f92e0067630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92ec006d90 tx=0x7f92ec032000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 msgr2=0x7f92fc138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc138fb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c3f0 tx=0x7f92f0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 shutdown_connections 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92e0065180 0x7f92e0067630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92fc13e730 0x7f92fc1394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92fc13e360 0x7f92fc138fb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 --2- 172.21.15.149:0/2346368745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92fc06a5e0 0x7f92fc175120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 >> 172.21.15.149:0/2346368745 conn(0x7f92fc0cc480 msgr2=0x7f92fc069400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 shutdown_connections 2024-08-17T02:46:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.787+0000 7f9304800640 1 -- 172.21.15.149:0/2346368745 wait complete. 2024-08-17T02:46:57.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.790+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84800cbaf0 con 0x7f84800cc800 2024-08-17T02:46:57.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.790+0000 7f8476a00640 1 -- 172.21.15.149:0/3990913353 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8478024030 con 0x7f84800cc800 2024-08-17T02:46:57.791 INFO:teuthology.orchestra.run.smithi149.stdout:64424509446 2024-08-17T02:46:57.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f845c065150 msgr2=0x7f845c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f845c065150 0x7f845c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8470033000 tx=0x7f8470036000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 msgr2=0x7f84800c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 0x7f84800c89c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8478017480 tx=0x7f8478008040 comp rx=0 tx=0).stop 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 shutdown_connections 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f845c065150 0x7f845c067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8480158c80 0x7f84800b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84800cd700 0x7f84800b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 --2- 172.21.15.149:0/3990913353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84800cc800 0x7f84800c89c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 >> 172.21.15.149:0/3990913353 conn(0x7f8480098e30 msgr2=0x7f84800ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 shutdown_connections 2024-08-17T02:46:57.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.793+0000 7f8484a00640 1 -- 172.21.15.149:0/3990913353 wait complete. 2024-08-17T02:46:57.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-08-17T02:46:57.803 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-08-17T02:46:57.810 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:57.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:46:57.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:57.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.999+0000 7f578fe00640 1 Processor -- start 2024-08-17T02:46:57.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:57.999+0000 7f578fe00640 1 -- start start 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57900afdd0 0x7f57901563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5790157690 con 0x7f5790155900 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578fe00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5790156a80 con 0x7f57900b0270 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5790156d60 con 0x7f57900afdd0 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578ea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5790155900 0x7f5790155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38020/0 (socket says 172.21.15.149:38020) 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578ea00640 1 -- 172.21.15.149:0/2932696453 learned_addr learned my addr 172.21.15.149:0/2932696453 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.000+0000 7f578f400640 1 --2- 172.21.15.149:0/2932696453 >> v2:172.21.15.149:3300/0 conn(0x7f57900afdd0 0x7f57901563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.001+0000 7f578f400640 1 -- 172.21.15.149:0/2932696453 >> v1:172.21.15.161:6789/0 conn(0x7f57900b0270 legacy=0x7f57900ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.001+0000 7f578f400640 1 -- 172.21.15.149:0/2932696453 >> v1:172.21.15.149:6789/0 conn(0x7f5790155900 legacy=0x7f5790155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.001+0000 7f578f400640 1 -- 172.21.15.149:0/2932696453 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790157040 con 0x7f57900afdd0 2024-08-17T02:46:58.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.001+0000 7f578e000640 1 -- 172.21.15.149:0/2932696453 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054114813 0 0) 0x7f5790157690 con 0x7f5790155900 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.002+0000 7f578f400640 1 --2- 172.21.15.149:0/2932696453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57900afdd0 0x7f57901563e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5788009e60 tx=0x7f5788009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f905a05ddcb446be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.002+0000 7f578e000640 1 -- 172.21.15.149:0/2932696453 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788007550 con 0x7f57900afdd0 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.002+0000 7f578e000640 1 -- 172.21.15.149:0/2932696453 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578802d050 con 0x7f57900afdd0 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.002+0000 7f578e000640 1 -- 172.21.15.149:0/2932696453 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57880078e0 con 0x7f57900afdd0 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 -- 172.21.15.149:0/2932696453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57900afdd0 msgr2=0x7f57901563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 --2- 172.21.15.149:0/2932696453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57900afdd0 0x7f57901563e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5788009e60 tx=0x7f5788009780 comp rx=0 tx=0).stop 2024-08-17T02:46:58.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 -- 172.21.15.149:0/2932696453 shutdown_connections 2024-08-17T02:46:58.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 --2- 172.21.15.149:0/2932696453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57900afdd0 0x7f57901563e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 -- 172.21.15.149:0/2932696453 >> 172.21.15.149:0/2932696453 conn(0x7f5790067750 msgr2=0x7f57900cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 -- 172.21.15.149:0/2932696453 shutdown_connections 2024-08-17T02:46:58.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.003+0000 7f578fe00640 1 -- 172.21.15.149:0/2932696453 wait complete. 2024-08-17T02:46:58.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.004+0000 7f578fe00640 1 Processor -- start 2024-08-17T02:46:58.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.004+0000 7f578fe00640 1 -- start start 2024-08-17T02:46:58.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.005+0000 7f578fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57900afdd0 0x7f5790168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.005+0000 7f578fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57900b0270 0x7f5790151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.005+0000 7f578fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 0x7f57900a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.005+0000 7f578fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790168eb0 con 0x7f5790155900 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.005+0000 7f578fe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579016bd50 con 0x7f57900afdd0 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.005+0000 7f578fe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c9420 con 0x7f57900b0270 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 0x7f57900a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 0x7f57900a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44098/0 (socket says 172.21.15.149:44098) 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 -- 172.21.15.149:0/508253868 learned_addr learned my addr 172.21.15.149:0/508253868 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578ea00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57900afdd0 0x7f5790168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f5786000640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57900b0270 0x7f5790151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 -- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57900b0270 msgr2=0x7f5790151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57900b0270 0x7f5790151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 -- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57900afdd0 msgr2=0x7f5790168970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57900afdd0 0x7f5790168970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 -- 172.21.15.149:0/508253868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009a20 con 0x7f5790155900 2024-08-17T02:46:58.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.006+0000 7f578f400640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 0x7f57900a5e90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5788009ec0 tx=0x7f5788037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.007+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788031960 con 0x7f5790155900 2024-08-17T02:46:58.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.007+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788040070 con 0x7f5790155900 2024-08-17T02:46:58.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.007+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788031cf0 con 0x7f5790155900 2024-08-17T02:46:58.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.007+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57901521b0 con 0x7f5790155900 2024-08-17T02:46:58.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.007+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900c88c0 con 0x7f5790155900 2024-08-17T02:46:58.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.008+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5790071050 con 0x7f5790155900 2024-08-17T02:46:58.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.009+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5788042070 con 0x7f5790155900 2024-08-17T02:46:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.009+0000 7f5786a00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f576c065150 0x7f576c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.009+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57880a3840 con 0x7f5790155900 2024-08-17T02:46:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.010+0000 7f578ea00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f576c065150 0x7f576c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.010+0000 7f578ea00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f576c065150 0x7f576c067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5780000c00 tx=0x7f5780007ea0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.014+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5788071910 con 0x7f5790155900 2024-08-17T02:46:58.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.191+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57900c9560 con 0x7f576c065150 2024-08-17T02:46:58.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.198+0000 7f5786a00640 1 -- 172.21.15.149:0/508253868 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264477 (secure 0 0 0) 0x7f57900c9560 con 0x7f576c065150 2024-08-17T02:46:58.202 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:58.203 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f576c065150 msgr2=0x7f576c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f576c065150 0x7f576c067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5780000c00 tx=0x7f5780007ea0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 msgr2=0x7f57900a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 0x7f57900a5e90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5788009ec0 tx=0x7f5788037000 comp rx=0 tx=0).stop 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 shutdown_connections 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f576c065150 0x7f576c067600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790155900 0x7f57900a5e90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57900b0270 0x7f5790151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 --2- 172.21.15.149:0/508253868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57900afdd0 0x7f5790168970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.202+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 >> 172.21.15.149:0/508253868 conn(0x7f5790067750 msgr2=0x7f57900af270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.203+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 shutdown_connections 2024-08-17T02:46:58.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.203+0000 7f578fe00640 1 -- 172.21.15.149:0/508253868 wait complete. 2024-08-17T02:46:58.218 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-08-17T02:46:57.627132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381828,"kb_used_data":2952,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592892,"statfs":{"total":773094113280,"available":770655121408,"internally_reserved":0,"allocated":3022848,"data_stored":1797316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.565830"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099636+0000","last_change":"2024-08-17T02:46:49.087269+0000","last_active":"2024-08-17T02:46:49.099636+0000","last_peered":"2024-08-17T02:46:49.099636+0000","last_clean":"2024-08-17T02:46:49.099636+0000","last_became_active":"2024-08-17T02:46:49.086977+0000","last_became_peered":"2024-08-17T02:46:49.086977+0000","last_unstale":"2024-08-17T02:46:49.099636+0000","last_undegraded":"2024-08-17T02:46:49.099636+0000","last_fullsized":"2024-08-17T02:46:49.099636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095362+0000","last_change":"2024-08-17T02:46:49.092074+0000","last_active":"2024-08-17T02:46:49.095362+0000","last_peered":"2024-08-17T02:46:49.095362+0000","last_clean":"2024-08-17T02:46:49.095362+0000","last_became_active":"2024-08-17T02:46:49.090161+0000","last_became_peered":"2024-08-17T02:46:49.090161+0000","last_unstale":"2024-08-17T02:46:49.095362+0000","last_undegraded":"2024-08-17T02:46:49.095362+0000","last_fullsized":"2024-08-17T02:46:49.095362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093760+0000","last_change":"2024-08-17T02:46:49.086579+0000","last_active":"2024-08-17T02:46:49.093760+0000","last_peered":"2024-08-17T02:46:49.093760+0000","last_clean":"2024-08-17T02:46:49.093760+0000","last_became_active":"2024-08-17T02:46:49.084975+0000","last_became_peered":"2024-08-17T02:46:49.084975+0000","last_unstale":"2024-08-17T02:46:49.093760+0000","last_undegraded":"2024-08-17T02:46:49.093760+0000","last_fullsized":"2024-08-17T02:46:49.093760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096542+0000","last_change":"2024-08-17T02:46:49.094697+0000","last_active":"2024-08-17T02:46:49.096542+0000","last_peered":"2024-08-17T02:46:49.096542+0000","last_clean":"2024-08-17T02:46:49.096542+0000","last_became_active":"2024-08-17T02:46:49.093541+0000","last_became_peered":"2024-08-17T02:46:49.093541+0000","last_unstale":"2024-08-17T02:46:49.096542+0000","last_undegraded":"2024-08-17T02:46:49.096542+0000","last_fullsized":"2024-08-17T02:46:49.096542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094318+0000","last_change":"2024-08-17T02:46:49.082685+0000","last_active":"2024-08-17T02:46:49.094318+0000","last_peered":"2024-08-17T02:46:49.094318+0000","last_clean":"2024-08-17T02:46:49.094318+0000","last_became_active":"2024-08-17T02:46:49.082382+0000","last_became_peered":"2024-08-17T02:46:49.082382+0000","last_unstale":"2024-08-17T02:46:49.094318+0000","last_undegraded":"2024-08-17T02:46:49.094318+0000","last_fullsized":"2024-08-17T02:46:49.094318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097478+0000","last_change":"2024-08-17T02:46:49.096292+0000","last_active":"2024-08-17T02:46:49.097478+0000","last_peered":"2024-08-17T02:46:49.097478+0000","last_clean":"2024-08-17T02:46:49.097478+0000","last_became_active":"2024-08-17T02:46:49.096030+0000","last_became_peered":"2024-08-17T02:46:49.096030+0000","last_unstale":"2024-08-17T02:46:49.097478+0000","last_undegraded":"2024-08-17T02:46:49.097478+0000","last_fullsized":"2024-08-17T02:46:49.097478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099438+0000","last_change":"2024-08-17T02:46:49.096389+0000","last_active":"2024-08-17T02:46:49.099438+0000","last_peered":"2024-08-17T02:46:49.099438+0000","last_clean":"2024-08-17T02:46:49.099438+0000","last_became_active":"2024-08-17T02:46:49.095461+0000","last_became_peered":"2024-08-17T02:46:49.095461+0000","last_unstale":"2024-08-17T02:46:49.099438+0000","last_undegraded":"2024-08-17T02:46:49.099438+0000","last_fullsized":"2024-08-17T02:46:49.099438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087502+0000","last_change":"2024-08-17T02:46:49.080927+0000","last_active":"2024-08-17T02:46:49.087502+0000","last_peered":"2024-08-17T02:46:49.087502+0000","last_clean":"2024-08-17T02:46:49.087502+0000","last_became_active":"2024-08-17T02:46:49.080697+0000","last_became_peered":"2024-08-17T02:46:49.080697+0000","last_unstale":"2024-08-17T02:46:49.087502+0000","last_undegraded":"2024-08-17T02:46:49.087502+0000","last_fullsized":"2024-08-17T02:46:49.087502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:02.889606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103298+0000","last_change":"2024-08-17T02:46:49.101464+0000","last_active":"2024-08-17T02:46:49.103298+0000","last_peered":"2024-08-17T02:46:49.103298+0000","last_clean":"2024-08-17T02:46:49.103298+0000","last_became_active":"2024-08-17T02:46:49.100349+0000","last_became_peered":"2024-08-17T02:46:49.100349+0000","last_unstale":"2024-08-17T02:46:49.103298+0000","last_undegraded":"2024-08-17T02:46:49.103298+0000","last_fullsized":"2024-08-17T02:46:49.103298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105488+0000","last_change":"2024-08-17T02:46:49.104176+0000","last_active":"2024-08-17T02:46:49.105488+0000","last_peered":"2024-08-17T02:46:49.105488+0000","last_clean":"2024-08-17T02:46:49.105488+0000","last_became_active":"2024-08-17T02:46:49.095015+0000","last_became_peered":"2024-08-17T02:46:49.095015+0000","last_unstale":"2024-08-17T02:46:49.105488+0000","last_undegraded":"2024-08-17T02:46:49.105488+0000","last_fullsized":"2024-08-17T02:46:49.105488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.085590+0000","last_change":"2024-08-17T02:46:49.082956+0000","last_active":"2024-08-17T02:46:49.085590+0000","last_peered":"2024-08-17T02:46:49.085590+0000","last_clean":"2024-08-17T02:46:49.085590+0000","last_became_active":"2024-08-17T02:46:49.080315+0000","last_became_peered":"2024-08-17T02:46:49.080315+0000","last_unstale":"2024-08-17T02:46:49.085590+0000","last_undegraded":"2024-08-17T02:46:49.085590+0000","last_fullsized":"2024-08-17T02:46:49.085590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.107656+0000","last_change":"2024-08-17T02:46:49.106327+0000","last_active":"2024-08-17T02:46:49.107656+0000","last_peered":"2024-08-17T02:46:49.107656+0000","last_clean":"2024-08-17T02:46:49.107656+0000","last_became_active":"2024-08-17T02:46:49.105995+0000","last_became_peered":"2024-08-17T02:46:49.105995+0000","last_unstale":"2024-08-17T02:46:49.107656+0000","last_undegraded":"2024-08-17T02:46:49.107656+0000","last_fullsized":"2024-08-17T02:46:49.107656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:20.150470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100233+0000","last_change":"2024-08-17T02:46:49.088848+0000","last_active":"2024-08-17T02:46:49.100233+0000","last_peered":"2024-08-17T02:46:49.100233+0000","last_clean":"2024-08-17T02:46:49.100233+0000","last_became_active":"2024-08-17T02:46:49.088404+0000","last_became_peered":"2024-08-17T02:46:49.088404+0000","last_unstale":"2024-08-17T02:46:49.100233+0000","last_undegraded":"2024-08-17T02:46:49.100233+0000","last_fullsized":"2024-08-17T02:46:49.100233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.089511+0000","last_change":"2024-08-17T02:46:49.074941+0000","last_active":"2024-08-17T02:46:49.089511+0000","last_peered":"2024-08-17T02:46:49.089511+0000","last_clean":"2024-08-17T02:46:49.089511+0000","last_became_active":"2024-08-17T02:46:49.074163+0000","last_became_peered":"2024-08-17T02:46:49.074163+0000","last_unstale":"2024-08-17T02:46:49.089511+0000","last_undegraded":"2024-08-17T02:46:49.089511+0000","last_fullsized":"2024-08-17T02:46:49.089511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086626+0000","last_change":"2024-08-17T02:46:49.081496+0000","last_active":"2024-08-17T02:46:49.086626+0000","last_peered":"2024-08-17T02:46:49.086626+0000","last_clean":"2024-08-17T02:46:49.086626+0000","last_became_active":"2024-08-17T02:46:49.081271+0000","last_became_peered":"2024-08-17T02:46:49.081271+0000","last_unstale":"2024-08-17T02:46:49.086626+0000","last_undegraded":"2024-08-17T02:46:49.086626+0000","last_fullsized":"2024-08-17T02:46:49.086626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079182+0000","last_change":"2024-08-17T02:46:49.075960+0000","last_active":"2024-08-17T02:46:49.079182+0000","last_peered":"2024-08-17T02:46:49.079182+0000","last_clean":"2024-08-17T02:46:49.079182+0000","last_became_active":"2024-08-17T02:46:49.075702+0000","last_became_peered":"2024-08-17T02:46:49.075702+0000","last_unstale":"2024-08-17T02:46:49.079182+0000","last_undegraded":"2024-08-17T02:46:49.079182+0000","last_fullsized":"2024-08-17T02:46:49.079182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093082+0000","last_change":"2024-08-17T02:46:49.090727+0000","last_active":"2024-08-17T02:46:49.093082+0000","last_peered":"2024-08-17T02:46:49.093082+0000","last_clean":"2024-08-17T02:46:49.093082+0000","last_became_active":"2024-08-17T02:46:49.090098+0000","last_became_peered":"2024-08-17T02:46:49.090098+0000","last_unstale":"2024-08-17T02:46:49.093082+0000","last_undegraded":"2024-08-17T02:46:49.093082+0000","last_fullsized":"2024-08-17T02:46:49.093082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092750+0000","last_change":"2024-08-17T02:46:49.090463+0000","last_active":"2024-08-17T02:46:49.092750+0000","last_peered":"2024-08-17T02:46:49.092750+0000","last_clean":"2024-08-17T02:46:49.092750+0000","last_became_active":"2024-08-17T02:46:49.090190+0000","last_became_peered":"2024-08-17T02:46:49.090190+0000","last_unstale":"2024-08-17T02:46:49.092750+0000","last_undegraded":"2024-08-17T02:46:49.092750+0000","last_fullsized":"2024-08-17T02:46:49.092750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:29.020704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094456+0000","last_change":"2024-08-17T02:46:49.090958+0000","last_active":"2024-08-17T02:46:49.094456+0000","last_peered":"2024-08-17T02:46:49.094456+0000","last_clean":"2024-08-17T02:46:49.094456+0000","last_became_active":"2024-08-17T02:46:49.089995+0000","last_became_peered":"2024-08-17T02:46:49.089995+0000","last_unstale":"2024-08-17T02:46:49.094456+0000","last_undegraded":"2024-08-17T02:46:49.094456+0000","last_fullsized":"2024-08-17T02:46:49.094456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105496+0000","last_change":"2024-08-17T02:46:49.087791+0000","last_active":"2024-08-17T02:46:49.105496+0000","last_peered":"2024-08-17T02:46:49.105496+0000","last_clean":"2024-08-17T02:46:49.105496+0000","last_became_active":"2024-08-17T02:46:49.087472+0000","last_became_peered":"2024-08-17T02:46:49.087472+0000","last_unstale":"2024-08-17T02:46:49.105496+0000","last_undegraded":"2024-08-17T02:46:49.105496+0000","last_fullsized":"2024-08-17T02:46:49.105496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097340+0000","last_change":"2024-08-17T02:46:49.094327+0000","last_active":"2024-08-17T02:46:49.097340+0000","last_peered":"2024-08-17T02:46:49.097340+0000","last_clean":"2024-08-17T02:46:49.097340+0000","last_became_active":"2024-08-17T02:46:49.087534+0000","last_became_peered":"2024-08-17T02:46:49.087534+0000","last_unstale":"2024-08-17T02:46:49.097340+0000","last_undegraded":"2024-08-17T02:46:49.097340+0000","last_fullsized":"2024-08-17T02:46:49.097340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092779+0000","last_change":"2024-08-17T02:46:49.086507+0000","last_active":"2024-08-17T02:46:49.092779+0000","last_peered":"2024-08-17T02:46:49.092779+0000","last_clean":"2024-08-17T02:46:49.092779+0000","last_became_active":"2024-08-17T02:46:49.086187+0000","last_became_peered":"2024-08-17T02:46:49.086187+0000","last_unstale":"2024-08-17T02:46:49.092779+0000","last_undegraded":"2024-08-17T02:46:49.092779+0000","last_fullsized":"2024-08-17T02:46:49.092779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093374+0000","last_change":"2024-08-17T02:46:49.087201+0000","last_active":"2024-08-17T02:46:49.093374+0000","last_peered":"2024-08-17T02:46:49.093374+0000","last_clean":"2024-08-17T02:46:49.093374+0000","last_became_active":"2024-08-17T02:46:49.086903+0000","last_became_peered":"2024-08-17T02:46:49.086903+0000","last_unstale":"2024-08-17T02:46:49.093374+0000","last_undegraded":"2024-08-17T02:46:49.093374+0000","last_fullsized":"2024-08-17T02:46:49.093374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:13.388708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093050+0000","last_change":"2024-08-17T02:46:49.084845+0000","last_active":"2024-08-17T02:46:49.093050+0000","last_peered":"2024-08-17T02:46:49.093050+0000","last_clean":"2024-08-17T02:46:49.093050+0000","last_became_active":"2024-08-17T02:46:49.084208+0000","last_became_peered":"2024-08-17T02:46:49.084208+0000","last_unstale":"2024-08-17T02:46:49.093050+0000","last_undegraded":"2024-08-17T02:46:49.093050+0000","last_fullsized":"2024-08-17T02:46:49.093050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100172+0000","last_change":"2024-08-17T02:46:49.088034+0000","last_active":"2024-08-17T02:46:49.100172+0000","last_peered":"2024-08-17T02:46:49.100172+0000","last_clean":"2024-08-17T02:46:49.100172+0000","last_became_active":"2024-08-17T02:46:49.085634+0000","last_became_peered":"2024-08-17T02:46:49.085634+0000","last_unstale":"2024-08-17T02:46:49.100172+0000","last_undegraded":"2024-08-17T02:46:49.100172+0000","last_fullsized":"2024-08-17T02:46:49.100172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:13.489732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104526+0000","last_change":"2024-08-17T02:46:49.093914+0000","last_active":"2024-08-17T02:46:49.104526+0000","last_peered":"2024-08-17T02:46:49.104526+0000","last_clean":"2024-08-17T02:46:49.104526+0000","last_became_active":"2024-08-17T02:46:49.093612+0000","last_became_peered":"2024-08-17T02:46:49.093612+0000","last_unstale":"2024-08-17T02:46:49.104526+0000","last_undegraded":"2024-08-17T02:46:49.104526+0000","last_fullsized":"2024-08-17T02:46:49.104526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094706+0000","last_change":"2024-08-17T02:46:49.091029+0000","last_active":"2024-08-17T02:46:49.094706+0000","last_peered":"2024-08-17T02:46:49.094706+0000","last_clean":"2024-08-17T02:46:49.094706+0000","last_became_active":"2024-08-17T02:46:49.090798+0000","last_became_peered":"2024-08-17T02:46:49.090798+0000","last_unstale":"2024-08-17T02:46:49.094706+0000","last_undegraded":"2024-08-17T02:46:49.094706+0000","last_fullsized":"2024-08-17T02:46:49.094706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103306+0000","last_change":"2024-08-17T02:46:49.097976+0000","last_active":"2024-08-17T02:46:49.103306+0000","last_peered":"2024-08-17T02:46:49.103306+0000","last_clean":"2024-08-17T02:46:49.103306+0000","last_became_active":"2024-08-17T02:46:49.095177+0000","last_became_peered":"2024-08-17T02:46:49.095177+0000","last_unstale":"2024-08-17T02:46:49.103306+0000","last_undegraded":"2024-08-17T02:46:49.103306+0000","last_fullsized":"2024-08-17T02:46:49.103306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.269002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097796+0000","last_change":"2024-08-17T02:46:49.094891+0000","last_active":"2024-08-17T02:46:49.097796+0000","last_peered":"2024-08-17T02:46:49.097796+0000","last_clean":"2024-08-17T02:46:49.097796+0000","last_became_active":"2024-08-17T02:46:49.094626+0000","last_became_peered":"2024-08-17T02:46:49.094626+0000","last_unstale":"2024-08-17T02:46:49.097796+0000","last_undegraded":"2024-08-17T02:46:49.097796+0000","last_fullsized":"2024-08-17T02:46:49.097796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092753+0000","last_change":"2024-08-17T02:46:49.085872+0000","last_active":"2024-08-17T02:46:49.092753+0000","last_peered":"2024-08-17T02:46:49.092753+0000","last_clean":"2024-08-17T02:46:49.092753+0000","last_became_active":"2024-08-17T02:46:49.085620+0000","last_became_peered":"2024-08-17T02:46:49.085620+0000","last_unstale":"2024-08-17T02:46:49.092753+0000","last_undegraded":"2024-08-17T02:46:49.092753+0000","last_fullsized":"2024-08-17T02:46:49.092753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087104+0000","last_change":"2024-08-17T02:46:49.079133+0000","last_active":"2024-08-17T02:46:49.087104+0000","last_peered":"2024-08-17T02:46:49.087104+0000","last_clean":"2024-08-17T02:46:49.087104+0000","last_became_active":"2024-08-17T02:46:49.078405+0000","last_became_peered":"2024-08-17T02:46:49.078405+0000","last_unstale":"2024-08-17T02:46:49.087104+0000","last_undegraded":"2024-08-17T02:46:49.087104+0000","last_fullsized":"2024-08-17T02:46:49.087104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:57.922654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.107061+0000","last_change":"2024-08-17T02:46:49.105591+0000","last_active":"2024-08-17T02:46:49.107061+0000","last_peered":"2024-08-17T02:46:49.107061+0000","last_clean":"2024-08-17T02:46:49.107061+0000","last_became_active":"2024-08-17T02:46:49.104220+0000","last_became_peered":"2024-08-17T02:46:49.104220+0000","last_unstale":"2024-08-17T02:46:49.107061+0000","last_undegraded":"2024-08-17T02:46:49.107061+0000","last_fullsized":"2024-08-17T02:46:49.107061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.078562+0000","last_change":"2024-08-17T02:46:49.072690+0000","last_active":"2024-08-17T02:46:49.078562+0000","last_peered":"2024-08-17T02:46:49.078562+0000","last_clean":"2024-08-17T02:46:49.078562+0000","last_became_active":"2024-08-17T02:46:49.072424+0000","last_became_peered":"2024-08-17T02:46:49.072424+0000","last_unstale":"2024-08-17T02:46:49.078562+0000","last_undegraded":"2024-08-17T02:46:49.078562+0000","last_fullsized":"2024-08-17T02:46:49.078562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:35.318940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099753+0000","last_change":"2024-08-17T02:46:48.085210+0000","last_active":"2024-08-17T02:46:49.099753+0000","last_peered":"2024-08-17T02:46:49.099753+0000","last_clean":"2024-08-17T02:46:49.099753+0000","last_became_active":"2024-08-17T02:46:48.084916+0000","last_became_peered":"2024-08-17T02:46:48.084916+0000","last_unstale":"2024-08-17T02:46:49.099753+0000","last_undegraded":"2024-08-17T02:46:49.099753+0000","last_fullsized":"2024-08-17T02:46:49.099753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087321+0000","last_change":"2024-08-17T02:46:49.080439+0000","last_active":"2024-08-17T02:46:49.087321+0000","last_peered":"2024-08-17T02:46:49.087321+0000","last_clean":"2024-08-17T02:46:49.087321+0000","last_became_active":"2024-08-17T02:46:49.080211+0000","last_became_peered":"2024-08-17T02:46:49.080211+0000","last_unstale":"2024-08-17T02:46:49.087321+0000","last_undegraded":"2024-08-17T02:46:49.087321+0000","last_fullsized":"2024-08-17T02:46:49.087321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105019+0000","last_change":"2024-08-17T02:46:48.090901+0000","last_active":"2024-08-17T02:46:49.105019+0000","last_peered":"2024-08-17T02:46:49.105019+0000","last_clean":"2024-08-17T02:46:49.105019+0000","last_became_active":"2024-08-17T02:46:48.089868+0000","last_became_peered":"2024-08-17T02:46:48.089868+0000","last_unstale":"2024-08-17T02:46:49.105019+0000","last_undegraded":"2024-08-17T02:46:49.105019+0000","last_fullsized":"2024-08-17T02:46:49.105019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079910+0000","last_change":"2024-08-17T02:46:48.076568+0000","last_active":"2024-08-17T02:46:49.079910+0000","last_peered":"2024-08-17T02:46:49.079910+0000","last_clean":"2024-08-17T02:46:49.079910+0000","last_became_active":"2024-08-17T02:46:48.076238+0000","last_became_peered":"2024-08-17T02:46:48.076238+0000","last_unstale":"2024-08-17T02:46:49.079910+0000","last_undegraded":"2024-08-17T02:46:49.079910+0000","last_fullsized":"2024-08-17T02:46:49.079910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103277+0000","last_change":"2024-08-17T02:46:49.095963+0000","last_active":"2024-08-17T02:46:49.103277+0000","last_peered":"2024-08-17T02:46:49.103277+0000","last_clean":"2024-08-17T02:46:49.103277+0000","last_became_active":"2024-08-17T02:46:49.095697+0000","last_became_peered":"2024-08-17T02:46:49.095697+0000","last_unstale":"2024-08-17T02:46:49.103277+0000","last_undegraded":"2024-08-17T02:46:49.103277+0000","last_fullsized":"2024-08-17T02:46:49.103277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066816+0000","last_change":"2024-08-17T02:46:48.090123+0000","last_active":"2024-08-17T02:46:49.066816+0000","last_peered":"2024-08-17T02:46:49.066816+0000","last_clean":"2024-08-17T02:46:49.066816+0000","last_became_active":"2024-08-17T02:46:48.089137+0000","last_became_peered":"2024-08-17T02:46:48.089137+0000","last_unstale":"2024-08-17T02:46:49.066816+0000","last_undegraded":"2024-08-17T02:46:49.066816+0000","last_fullsized":"2024-08-17T02:46:49.066816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094584+0000","last_change":"2024-08-17T02:46:49.086912+0000","last_active":"2024-08-17T02:46:49.094584+0000","last_peered":"2024-08-17T02:46:49.094584+0000","last_clean":"2024-08-17T02:46:49.094584+0000","last_became_active":"2024-08-17T02:46:49.086607+0000","last_became_peered":"2024-08-17T02:46:49.086607+0000","last_unstale":"2024-08-17T02:46:49.094584+0000","last_undegraded":"2024-08-17T02:46:49.094584+0000","last_fullsized":"2024-08-17T02:46:49.094584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071998+0000","last_change":"2024-08-17T02:46:48.082227+0000","last_active":"2024-08-17T02:46:49.071998+0000","last_peered":"2024-08-17T02:46:49.071998+0000","last_clean":"2024-08-17T02:46:49.071998+0000","last_became_active":"2024-08-17T02:46:48.081670+0000","last_became_peered":"2024-08-17T02:46:48.081670+0000","last_unstale":"2024-08-17T02:46:49.071998+0000","last_undegraded":"2024-08-17T02:46:49.071998+0000","last_fullsized":"2024-08-17T02:46:49.071998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093016+0000","last_change":"2024-08-17T02:46:49.089798+0000","last_active":"2024-08-17T02:46:49.093016+0000","last_peered":"2024-08-17T02:46:49.093016+0000","last_clean":"2024-08-17T02:46:49.093016+0000","last_became_active":"2024-08-17T02:46:49.088859+0000","last_became_peered":"2024-08-17T02:46:49.088859+0000","last_unstale":"2024-08-17T02:46:49.093016+0000","last_undegraded":"2024-08-17T02:46:49.093016+0000","last_fullsized":"2024-08-17T02:46:49.093016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.067403+0000","last_change":"2024-08-17T02:46:48.075698+0000","last_active":"2024-08-17T02:46:49.067403+0000","last_peered":"2024-08-17T02:46:49.067403+0000","last_clean":"2024-08-17T02:46:49.067403+0000","last_became_active":"2024-08-17T02:46:48.075409+0000","last_became_peered":"2024-08-17T02:46:48.075409+0000","last_unstale":"2024-08-17T02:46:49.067403+0000","last_undegraded":"2024-08-17T02:46:49.067403+0000","last_fullsized":"2024-08-17T02:46:49.067403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094421+0000","last_change":"2024-08-17T02:46:49.090547+0000","last_active":"2024-08-17T02:46:49.094421+0000","last_peered":"2024-08-17T02:46:49.094421+0000","last_clean":"2024-08-17T02:46:49.094421+0000","last_became_active":"2024-08-17T02:46:49.090316+0000","last_became_peered":"2024-08-17T02:46:49.090316+0000","last_unstale":"2024-08-17T02:46:49.094421+0000","last_undegraded":"2024-08-17T02:46:49.094421+0000","last_fullsized":"2024-08-17T02:46:49.094421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097432+0000","last_change":"2024-08-17T02:46:48.079760+0000","last_active":"2024-08-17T02:46:49.097432+0000","last_peered":"2024-08-17T02:46:49.097432+0000","last_clean":"2024-08-17T02:46:49.097432+0000","last_became_active":"2024-08-17T02:46:48.079517+0000","last_became_peered":"2024-08-17T02:46:48.079517+0000","last_unstale":"2024-08-17T02:46:49.097432+0000","last_undegraded":"2024-08-17T02:46:49.097432+0000","last_fullsized":"2024-08-17T02:46:49.097432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:10:17.014457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097729+0000","last_change":"2024-08-17T02:46:49.091777+0000","last_active":"2024-08-17T02:46:49.097729+0000","last_peered":"2024-08-17T02:46:49.097729+0000","last_clean":"2024-08-17T02:46:49.097729+0000","last_became_active":"2024-08-17T02:46:49.085179+0000","last_became_peered":"2024-08-17T02:46:49.085179+0000","last_unstale":"2024-08-17T02:46:49.097729+0000","last_undegraded":"2024-08-17T02:46:49.097729+0000","last_fullsized":"2024-08-17T02:46:49.097729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:28.274012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.113032+0000","last_change":"2024-08-17T02:46:48.080838+0000","last_active":"2024-08-17T02:46:49.113032+0000","last_peered":"2024-08-17T02:46:49.113032+0000","last_clean":"2024-08-17T02:46:49.113032+0000","last_became_active":"2024-08-17T02:46:48.080291+0000","last_became_peered":"2024-08-17T02:46:48.080291+0000","last_unstale":"2024-08-17T02:46:49.113032+0000","last_undegraded":"2024-08-17T02:46:49.113032+0000","last_fullsized":"2024-08-17T02:46:49.113032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094435+0000","last_change":"2024-08-17T02:46:49.088724+0000","last_active":"2024-08-17T02:46:49.094435+0000","last_peered":"2024-08-17T02:46:49.094435+0000","last_clean":"2024-08-17T02:46:49.094435+0000","last_became_active":"2024-08-17T02:46:49.088123+0000","last_became_peered":"2024-08-17T02:46:49.088123+0000","last_unstale":"2024-08-17T02:46:49.094435+0000","last_undegraded":"2024-08-17T02:46:49.094435+0000","last_fullsized":"2024-08-17T02:46:49.094435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.102422+0000","last_change":"2024-08-17T02:46:48.091037+0000","last_active":"2024-08-17T02:46:49.102422+0000","last_peered":"2024-08-17T02:46:49.102422+0000","last_clean":"2024-08-17T02:46:49.102422+0000","last_became_active":"2024-08-17T02:46:48.090779+0000","last_became_peered":"2024-08-17T02:46:48.090779+0000","last_unstale":"2024-08-17T02:46:49.102422+0000","last_undegraded":"2024-08-17T02:46:49.102422+0000","last_fullsized":"2024-08-17T02:46:49.102422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094625+0000","last_change":"2024-08-17T02:46:49.089937+0000","last_active":"2024-08-17T02:46:49.094625+0000","last_peered":"2024-08-17T02:46:49.094625+0000","last_clean":"2024-08-17T02:46:49.094625+0000","last_became_active":"2024-08-17T02:46:49.089635+0000","last_became_peered":"2024-08-17T02:46:49.089635+0000","last_unstale":"2024-08-17T02:46:49.094625+0000","last_undegraded":"2024-08-17T02:46:49.094625+0000","last_fullsized":"2024-08-17T02:46:49.094625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068360+0000","last_change":"2024-08-17T02:46:48.078674+0000","last_active":"2024-08-17T02:46:49.068360+0000","last_peered":"2024-08-17T02:46:49.068360+0000","last_clean":"2024-08-17T02:46:49.068360+0000","last_became_active":"2024-08-17T02:46:48.078254+0000","last_became_peered":"2024-08-17T02:46:48.078254+0000","last_unstale":"2024-08-17T02:46:49.068360+0000","last_undegraded":"2024-08-17T02:46:49.068360+0000","last_fullsized":"2024-08-17T02:46:49.068360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094338+0000","last_change":"2024-08-17T02:46:49.083382+0000","last_active":"2024-08-17T02:46:49.094338+0000","last_peered":"2024-08-17T02:46:49.094338+0000","last_clean":"2024-08-17T02:46:49.094338+0000","last_became_active":"2024-08-17T02:46:49.083117+0000","last_became_peered":"2024-08-17T02:46:49.083117+0000","last_unstale":"2024-08-17T02:46:49.094338+0000","last_undegraded":"2024-08-17T02:46:49.094338+0000","last_fullsized":"2024-08-17T02:46:49.094338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.072280+0000","last_change":"2024-08-17T02:46:48.090201+0000","last_active":"2024-08-17T02:46:49.072280+0000","last_peered":"2024-08-17T02:46:49.072280+0000","last_clean":"2024-08-17T02:46:49.072280+0000","last_became_active":"2024-08-17T02:46:48.088890+0000","last_became_peered":"2024-08-17T02:46:48.088890+0000","last_unstale":"2024-08-17T02:46:49.072280+0000","last_undegraded":"2024-08-17T02:46:49.072280+0000","last_fullsized":"2024-08-17T02:46:49.072280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:52.864560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.107083+0000","last_change":"2024-08-17T02:46:49.105595+0000","last_active":"2024-08-17T02:46:49.107083+0000","last_peered":"2024-08-17T02:46:49.107083+0000","last_clean":"2024-08-17T02:46:49.107083+0000","last_became_active":"2024-08-17T02:46:49.104413+0000","last_became_peered":"2024-08-17T02:46:49.104413+0000","last_unstale":"2024-08-17T02:46:49.107083+0000","last_undegraded":"2024-08-17T02:46:49.107083+0000","last_fullsized":"2024-08-17T02:46:49.107083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096457+0000","last_change":"2024-08-17T02:46:48.078982+0000","last_active":"2024-08-17T02:46:49.096457+0000","last_peered":"2024-08-17T02:46:49.096457+0000","last_clean":"2024-08-17T02:46:49.096457+0000","last_became_active":"2024-08-17T02:46:48.078749+0000","last_became_peered":"2024-08-17T02:46:48.078749+0000","last_unstale":"2024-08-17T02:46:49.096457+0000","last_undegraded":"2024-08-17T02:46:49.096457+0000","last_fullsized":"2024-08-17T02:46:49.096457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.090546+0000","last_change":"2024-08-17T02:46:49.082500+0000","last_active":"2024-08-17T02:46:49.090546+0000","last_peered":"2024-08-17T02:46:49.090546+0000","last_clean":"2024-08-17T02:46:49.090546+0000","last_became_active":"2024-08-17T02:46:49.081473+0000","last_became_peered":"2024-08-17T02:46:49.081473+0000","last_unstale":"2024-08-17T02:46:49.090546+0000","last_undegraded":"2024-08-17T02:46:49.090546+0000","last_fullsized":"2024-08-17T02:46:49.090546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099263+0000","last_change":"2024-08-17T02:46:48.087651+0000","last_active":"2024-08-17T02:46:49.099263+0000","last_peered":"2024-08-17T02:46:49.099263+0000","last_clean":"2024-08-17T02:46:49.099263+0000","last_became_active":"2024-08-17T02:46:48.086669+0000","last_became_peered":"2024-08-17T02:46:48.086669+0000","last_unstale":"2024-08-17T02:46:49.099263+0000","last_undegraded":"2024-08-17T02:46:49.099263+0000","last_fullsized":"2024-08-17T02:46:49.099263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:51.853156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.091076+0000","last_change":"2024-08-17T02:46:49.083492+0000","last_active":"2024-08-17T02:46:49.091076+0000","last_peered":"2024-08-17T02:46:49.091076+0000","last_clean":"2024-08-17T02:46:49.091076+0000","last_became_active":"2024-08-17T02:46:49.083219+0000","last_became_peered":"2024-08-17T02:46:49.083219+0000","last_unstale":"2024-08-17T02:46:49.091076+0000","last_undegraded":"2024-08-17T02:46:49.091076+0000","last_fullsized":"2024-08-17T02:46:49.091076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087839+0000","last_change":"2024-08-17T02:46:48.077491+0000","last_active":"2024-08-17T02:46:49.087839+0000","last_peered":"2024-08-17T02:46:49.087839+0000","last_clean":"2024-08-17T02:46:49.087839+0000","last_became_active":"2024-08-17T02:46:48.076811+0000","last_became_peered":"2024-08-17T02:46:48.076811+0000","last_unstale":"2024-08-17T02:46:49.087839+0000","last_undegraded":"2024-08-17T02:46:49.087839+0000","last_fullsized":"2024-08-17T02:46:49.087839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103569+0000","last_change":"2024-08-17T02:46:49.101717+0000","last_active":"2024-08-17T02:46:49.103569+0000","last_peered":"2024-08-17T02:46:49.103569+0000","last_clean":"2024-08-17T02:46:49.103569+0000","last_became_active":"2024-08-17T02:46:49.101402+0000","last_became_peered":"2024-08-17T02:46:49.101402+0000","last_unstale":"2024-08-17T02:46:49.103569+0000","last_undegraded":"2024-08-17T02:46:49.103569+0000","last_fullsized":"2024-08-17T02:46:49.103569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:31.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097911+0000","last_change":"2024-08-17T02:46:48.088763+0000","last_active":"2024-08-17T02:46:49.097911+0000","last_peered":"2024-08-17T02:46:49.097911+0000","last_clean":"2024-08-17T02:46:49.097911+0000","last_became_active":"2024-08-17T02:46:48.088515+0000","last_became_peered":"2024-08-17T02:46:48.088515+0000","last_unstale":"2024-08-17T02:46:49.097911+0000","last_undegraded":"2024-08-17T02:46:49.097911+0000","last_fullsized":"2024-08-17T02:46:49.097911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:47.407554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095108+0000","last_change":"2024-08-17T02:46:49.091638+0000","last_active":"2024-08-17T02:46:49.095108+0000","last_peered":"2024-08-17T02:46:49.095108+0000","last_clean":"2024-08-17T02:46:49.095108+0000","last_became_active":"2024-08-17T02:46:49.091395+0000","last_became_peered":"2024-08-17T02:46:49.091395+0000","last_unstale":"2024-08-17T02:46:49.095108+0000","last_undegraded":"2024-08-17T02:46:49.095108+0000","last_fullsized":"2024-08-17T02:46:49.095108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071417+0000","last_change":"2024-08-17T02:46:48.081129+0000","last_active":"2024-08-17T02:46:49.071417+0000","last_peered":"2024-08-17T02:46:49.071417+0000","last_clean":"2024-08-17T02:46:49.071417+0000","last_became_active":"2024-08-17T02:46:48.080849+0000","last_became_peered":"2024-08-17T02:46:48.080849+0000","last_unstale":"2024-08-17T02:46:49.071417+0000","last_undegraded":"2024-08-17T02:46:49.071417+0000","last_fullsized":"2024-08-17T02:46:49.071417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:37.122554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103233+0000","last_change":"2024-08-17T02:46:49.100757+0000","last_active":"2024-08-17T02:46:49.103233+0000","last_peered":"2024-08-17T02:46:49.103233+0000","last_clean":"2024-08-17T02:46:49.103233+0000","last_became_active":"2024-08-17T02:46:49.100157+0000","last_became_peered":"2024-08-17T02:46:49.100157+0000","last_unstale":"2024-08-17T02:46:49.103233+0000","last_undegraded":"2024-08-17T02:46:49.103233+0000","last_fullsized":"2024-08-17T02:46:49.103233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.070174+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:46:49.070174+0000","last_peered":"2024-08-17T02:46:49.070174+0000","last_clean":"2024-08-17T02:46:49.070174+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:46:49.070174+0000","last_undegraded":"2024-08-17T02:46:49.070174+0000","last_fullsized":"2024-08-17T02:46:49.070174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066868+0000","last_change":"2024-08-17T02:46:48.079170+0000","last_active":"2024-08-17T02:46:49.066868+0000","last_peered":"2024-08-17T02:46:49.066868+0000","last_clean":"2024-08-17T02:46:49.066868+0000","last_became_active":"2024-08-17T02:46:48.078398+0000","last_became_peered":"2024-08-17T02:46:48.078398+0000","last_unstale":"2024-08-17T02:46:49.066868+0000","last_undegraded":"2024-08-17T02:46:49.066868+0000","last_fullsized":"2024-08-17T02:46:49.066868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087841+0000","last_change":"2024-08-17T02:46:49.083909+0000","last_active":"2024-08-17T02:46:49.087841+0000","last_peered":"2024-08-17T02:46:49.087841+0000","last_clean":"2024-08-17T02:46:49.087841+0000","last_became_active":"2024-08-17T02:46:49.083625+0000","last_became_peered":"2024-08-17T02:46:49.083625+0000","last_unstale":"2024-08-17T02:46:49.087841+0000","last_undegraded":"2024-08-17T02:46:49.087841+0000","last_fullsized":"2024-08-17T02:46:49.087841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:36.672843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.070091+0000","last_change":"2024-08-17T02:46:48.091863+0000","last_active":"2024-08-17T02:46:49.070091+0000","last_peered":"2024-08-17T02:46:49.070091+0000","last_clean":"2024-08-17T02:46:49.070091+0000","last_became_active":"2024-08-17T02:46:48.091526+0000","last_became_peered":"2024-08-17T02:46:48.091526+0000","last_unstale":"2024-08-17T02:46:49.070091+0000","last_undegraded":"2024-08-17T02:46:49.070091+0000","last_fullsized":"2024-08-17T02:46:49.070091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:27.266794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093823+0000","last_change":"2024-08-17T02:46:49.087183+0000","last_active":"2024-08-17T02:46:49.093823+0000","last_peered":"2024-08-17T02:46:49.093823+0000","last_clean":"2024-08-17T02:46:49.093823+0000","last_became_active":"2024-08-17T02:46:49.086849+0000","last_became_peered":"2024-08-17T02:46:49.086849+0000","last_unstale":"2024-08-17T02:46:49.093823+0000","last_undegraded":"2024-08-17T02:46:49.093823+0000","last_fullsized":"2024-08-17T02:46:49.093823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071993+0000","last_change":"2024-08-17T02:46:48.084642+0000","last_active":"2024-08-17T02:46:49.071993+0000","last_peered":"2024-08-17T02:46:49.071993+0000","last_clean":"2024-08-17T02:46:49.071993+0000","last_became_active":"2024-08-17T02:46:48.084341+0000","last_became_peered":"2024-08-17T02:46:48.084341+0000","last_unstale":"2024-08-17T02:46:49.071993+0000","last_undegraded":"2024-08-17T02:46:49.071993+0000","last_fullsized":"2024-08-17T02:46:49.071993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095221+0000","last_change":"2024-08-17T02:46:49.088066+0000","last_active":"2024-08-17T02:46:49.095221+0000","last_peered":"2024-08-17T02:46:49.095221+0000","last_clean":"2024-08-17T02:46:49.095221+0000","last_became_active":"2024-08-17T02:46:49.084322+0000","last_became_peered":"2024-08-17T02:46:49.084322+0000","last_unstale":"2024-08-17T02:46:49.095221+0000","last_undegraded":"2024-08-17T02:46:49.095221+0000","last_fullsized":"2024-08-17T02:46:49.095221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068469+0000","last_change":"2024-08-17T02:46:48.081051+0000","last_active":"2024-08-17T02:46:49.068469+0000","last_peered":"2024-08-17T02:46:49.068469+0000","last_clean":"2024-08-17T02:46:49.068469+0000","last_became_active":"2024-08-17T02:46:48.080649+0000","last_became_peered":"2024-08-17T02:46:48.080649+0000","last_unstale":"2024-08-17T02:46:49.068469+0000","last_undegraded":"2024-08-17T02:46:49.068469+0000","last_fullsized":"2024-08-17T02:46:49.068469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.098061+0000","last_change":"2024-08-17T02:46:49.094024+0000","last_active":"2024-08-17T02:46:49.098061+0000","last_peered":"2024-08-17T02:46:49.098061+0000","last_clean":"2024-08-17T02:46:49.098061+0000","last_became_active":"2024-08-17T02:46:49.093680+0000","last_became_peered":"2024-08-17T02:46:49.093680+0000","last_unstale":"2024-08-17T02:46:49.098061+0000","last_undegraded":"2024-08-17T02:46:49.098061+0000","last_fullsized":"2024-08-17T02:46:49.098061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:57.304010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063798+0000","last_change":"2024-08-17T02:46:48.078992+0000","last_active":"2024-08-17T02:46:49.063798+0000","last_peered":"2024-08-17T02:46:49.063798+0000","last_clean":"2024-08-17T02:46:49.063798+0000","last_became_active":"2024-08-17T02:46:48.078756+0000","last_became_peered":"2024-08-17T02:46:48.078756+0000","last_unstale":"2024-08-17T02:46:49.063798+0000","last_undegraded":"2024-08-17T02:46:49.063798+0000","last_fullsized":"2024-08-17T02:46:49.063798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:54.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095301+0000","last_change":"2024-08-17T02:46:49.088373+0000","last_active":"2024-08-17T02:46:49.095301+0000","last_peered":"2024-08-17T02:46:49.095301+0000","last_clean":"2024-08-17T02:46:49.095301+0000","last_became_active":"2024-08-17T02:46:49.087461+0000","last_became_peered":"2024-08-17T02:46:49.087461+0000","last_unstale":"2024-08-17T02:46:49.095301+0000","last_undegraded":"2024-08-17T02:46:49.095301+0000","last_fullsized":"2024-08-17T02:46:49.095301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.076647+0000","last_change":"2024-08-17T02:46:48.089957+0000","last_active":"2024-08-17T02:46:49.076647+0000","last_peered":"2024-08-17T02:46:49.076647+0000","last_clean":"2024-08-17T02:46:49.076647+0000","last_became_active":"2024-08-17T02:46:48.089649+0000","last_became_peered":"2024-08-17T02:46:48.089649+0000","last_unstale":"2024-08-17T02:46:49.076647+0000","last_undegraded":"2024-08-17T02:46:49.076647+0000","last_fullsized":"2024-08-17T02:46:49.076647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083036+0000","last_change":"2024-08-17T02:46:49.078454+0000","last_active":"2024-08-17T02:46:49.083036+0000","last_peered":"2024-08-17T02:46:49.083036+0000","last_clean":"2024-08-17T02:46:49.083036+0000","last_became_active":"2024-08-17T02:46:49.078210+0000","last_became_peered":"2024-08-17T02:46:49.078210+0000","last_unstale":"2024-08-17T02:46:49.083036+0000","last_undegraded":"2024-08-17T02:46:49.083036+0000","last_fullsized":"2024-08-17T02:46:49.083036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:46:50.082936+0000","last_change":"2024-08-17T02:46:48.077368+0000","last_active":"2024-08-17T02:46:50.082936+0000","last_peered":"2024-08-17T02:46:50.082936+0000","last_clean":"2024-08-17T02:46:50.082936+0000","last_became_active":"2024-08-17T02:46:48.077133+0000","last_became_peered":"2024-08-17T02:46:48.077133+0000","last_unstale":"2024-08-17T02:46:50.082936+0000","last_undegraded":"2024-08-17T02:46:50.082936+0000","last_fullsized":"2024-08-17T02:46:50.082936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103611+0000","last_change":"2024-08-17T02:46:49.101882+0000","last_active":"2024-08-17T02:46:49.103611+0000","last_peered":"2024-08-17T02:46:49.103611+0000","last_clean":"2024-08-17T02:46:49.103611+0000","last_became_active":"2024-08-17T02:46:49.101646+0000","last_became_peered":"2024-08-17T02:46:49.101646+0000","last_unstale":"2024-08-17T02:46:49.103611+0000","last_undegraded":"2024-08-17T02:46:49.103611+0000","last_fullsized":"2024-08-17T02:46:49.103611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104030+0000","last_change":"2024-08-17T02:46:48.081324+0000","last_active":"2024-08-17T02:46:49.104030+0000","last_peered":"2024-08-17T02:46:49.104030+0000","last_clean":"2024-08-17T02:46:49.104030+0000","last_became_active":"2024-08-17T02:46:48.078219+0000","last_became_peered":"2024-08-17T02:46:48.078219+0000","last_unstale":"2024-08-17T02:46:49.104030+0000","last_undegraded":"2024-08-17T02:46:49.104030+0000","last_fullsized":"2024-08-17T02:46:49.104030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086252+0000","last_change":"2024-08-17T02:46:49.081991+0000","last_active":"2024-08-17T02:46:49.086252+0000","last_peered":"2024-08-17T02:46:49.086252+0000","last_clean":"2024-08-17T02:46:49.086252+0000","last_became_active":"2024-08-17T02:46:49.081605+0000","last_became_peered":"2024-08-17T02:46:49.081605+0000","last_unstale":"2024-08-17T02:46:49.086252+0000","last_undegraded":"2024-08-17T02:46:49.086252+0000","last_fullsized":"2024-08-17T02:46:49.086252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:09.169449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.070006+0000","last_change":"2024-08-17T02:46:48.087420+0000","last_active":"2024-08-17T02:46:49.070006+0000","last_peered":"2024-08-17T02:46:49.070006+0000","last_clean":"2024-08-17T02:46:49.070006+0000","last_became_active":"2024-08-17T02:46:48.087176+0000","last_became_peered":"2024-08-17T02:46:48.087176+0000","last_unstale":"2024-08-17T02:46:49.070006+0000","last_undegraded":"2024-08-17T02:46:49.070006+0000","last_fullsized":"2024-08-17T02:46:49.070006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:56.296792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080285+0000","last_change":"2024-08-17T02:46:49.079248+0000","last_active":"2024-08-17T02:46:49.080285+0000","last_peered":"2024-08-17T02:46:49.080285+0000","last_clean":"2024-08-17T02:46:49.080285+0000","last_became_active":"2024-08-17T02:46:49.078901+0000","last_became_peered":"2024-08-17T02:46:49.078901+0000","last_unstale":"2024-08-17T02:46:49.080285+0000","last_undegraded":"2024-08-17T02:46:49.080285+0000","last_fullsized":"2024-08-17T02:46:49.080285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:41.552959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063585+0000","last_change":"2024-08-17T02:46:48.087189+0000","last_active":"2024-08-17T02:46:49.063585+0000","last_peered":"2024-08-17T02:46:49.063585+0000","last_clean":"2024-08-17T02:46:49.063585+0000","last_became_active":"2024-08-17T02:46:48.086418+0000","last_became_peered":"2024-08-17T02:46:48.086418+0000","last_unstale":"2024-08-17T02:46:49.063585+0000","last_undegraded":"2024-08-17T02:46:49.063585+0000","last_fullsized":"2024-08-17T02:46:49.063585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:56.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.085453+0000","last_change":"2024-08-17T02:46:49.080433+0000","last_active":"2024-08-17T02:46:49.085453+0000","last_peered":"2024-08-17T02:46:49.085453+0000","last_clean":"2024-08-17T02:46:49.085453+0000","last_became_active":"2024-08-17T02:46:49.080054+0000","last_became_peered":"2024-08-17T02:46:49.080054+0000","last_unstale":"2024-08-17T02:46:49.085453+0000","last_undegraded":"2024-08-17T02:46:49.085453+0000","last_fullsized":"2024-08-17T02:46:49.085453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063075+0000","last_change":"2024-08-17T02:46:48.077229+0000","last_active":"2024-08-17T02:46:49.063075+0000","last_peered":"2024-08-17T02:46:49.063075+0000","last_clean":"2024-08-17T02:46:49.063075+0000","last_became_active":"2024-08-17T02:46:48.076984+0000","last_became_peered":"2024-08-17T02:46:48.076984+0000","last_unstale":"2024-08-17T02:46:49.063075+0000","last_undegraded":"2024-08-17T02:46:49.063075+0000","last_fullsized":"2024-08-17T02:46:49.063075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103538+0000","last_change":"2024-08-17T02:46:49.098807+0000","last_active":"2024-08-17T02:46:49.103538+0000","last_peered":"2024-08-17T02:46:49.103538+0000","last_clean":"2024-08-17T02:46:49.103538+0000","last_became_active":"2024-08-17T02:46:49.098544+0000","last_became_peered":"2024-08-17T02:46:49.098544+0000","last_unstale":"2024-08-17T02:46:49.103538+0000","last_undegraded":"2024-08-17T02:46:49.103538+0000","last_fullsized":"2024-08-17T02:46:49.103538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103214+0000","last_change":"2024-08-17T02:46:48.093596+0000","last_active":"2024-08-17T02:46:49.103214+0000","last_peered":"2024-08-17T02:46:49.103214+0000","last_clean":"2024-08-17T02:46:49.103214+0000","last_became_active":"2024-08-17T02:46:48.093268+0000","last_became_peered":"2024-08-17T02:46:48.093268+0000","last_unstale":"2024-08-17T02:46:49.103214+0000","last_undegraded":"2024-08-17T02:46:49.103214+0000","last_fullsized":"2024-08-17T02:46:49.103214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103393+0000","last_change":"2024-08-17T02:46:49.082223+0000","last_active":"2024-08-17T02:46:49.103393+0000","last_peered":"2024-08-17T02:46:49.103393+0000","last_clean":"2024-08-17T02:46:49.103393+0000","last_became_active":"2024-08-17T02:46:49.081793+0000","last_became_peered":"2024-08-17T02:46:49.081793+0000","last_unstale":"2024-08-17T02:46:49.103393+0000","last_undegraded":"2024-08-17T02:46:49.103393+0000","last_fullsized":"2024-08-17T02:46:49.103393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079110+0000","last_change":"2024-08-17T02:46:49.074753+0000","last_active":"2024-08-17T02:46:49.079110+0000","last_peered":"2024-08-17T02:46:49.079110+0000","last_clean":"2024-08-17T02:46:49.079110+0000","last_became_active":"2024-08-17T02:46:49.074319+0000","last_became_peered":"2024-08-17T02:46:49.074319+0000","last_unstale":"2024-08-17T02:46:49.079110+0000","last_undegraded":"2024-08-17T02:46:49.079110+0000","last_fullsized":"2024-08-17T02:46:49.079110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104043+0000","last_change":"2024-08-17T02:46:48.091988+0000","last_active":"2024-08-17T02:46:49.104043+0000","last_peered":"2024-08-17T02:46:49.104043+0000","last_clean":"2024-08-17T02:46:49.104043+0000","last_became_active":"2024-08-17T02:46:48.091617+0000","last_became_peered":"2024-08-17T02:46:48.091617+0000","last_unstale":"2024-08-17T02:46:49.104043+0000","last_undegraded":"2024-08-17T02:46:49.104043+0000","last_fullsized":"2024-08-17T02:46:49.104043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080144+0000","last_change":"2024-08-17T02:46:49.078397+0000","last_active":"2024-08-17T02:46:49.080144+0000","last_peered":"2024-08-17T02:46:49.080144+0000","last_clean":"2024-08-17T02:46:49.080144+0000","last_became_active":"2024-08-17T02:46:49.078122+0000","last_became_peered":"2024-08-17T02:46:49.078122+0000","last_unstale":"2024-08-17T02:46:49.080144+0000","last_undegraded":"2024-08-17T02:46:49.080144+0000","last_fullsized":"2024-08-17T02:46:49.080144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104896+0000","last_change":"2024-08-17T02:46:48.092015+0000","last_active":"2024-08-17T02:46:49.104896+0000","last_peered":"2024-08-17T02:46:49.104896+0000","last_clean":"2024-08-17T02:46:49.104896+0000","last_became_active":"2024-08-17T02:46:48.091717+0000","last_became_peered":"2024-08-17T02:46:48.091717+0000","last_unstale":"2024-08-17T02:46:49.104896+0000","last_undegraded":"2024-08-17T02:46:49.104896+0000","last_fullsized":"2024-08-17T02:46:49.104896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:40.545742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094395+0000","last_change":"2024-08-17T02:46:49.089752+0000","last_active":"2024-08-17T02:46:49.094395+0000","last_peered":"2024-08-17T02:46:49.094395+0000","last_clean":"2024-08-17T02:46:49.094395+0000","last_became_active":"2024-08-17T02:46:49.089497+0000","last_became_peered":"2024-08-17T02:46:49.089497+0000","last_unstale":"2024-08-17T02:46:49.094395+0000","last_undegraded":"2024-08-17T02:46:49.094395+0000","last_fullsized":"2024-08-17T02:46:49.094395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.098272+0000","last_change":"2024-08-17T02:46:48.082388+0000","last_active":"2024-08-17T02:46:49.098272+0000","last_peered":"2024-08-17T02:46:49.098272+0000","last_clean":"2024-08-17T02:46:49.098272+0000","last_became_active":"2024-08-17T02:46:48.082137+0000","last_became_peered":"2024-08-17T02:46:48.082137+0000","last_unstale":"2024-08-17T02:46:49.098272+0000","last_undegraded":"2024-08-17T02:46:49.098272+0000","last_fullsized":"2024-08-17T02:46:49.098272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100362+0000","last_change":"2024-08-17T02:46:49.091589+0000","last_active":"2024-08-17T02:46:49.100362+0000","last_peered":"2024-08-17T02:46:49.100362+0000","last_clean":"2024-08-17T02:46:49.100362+0000","last_became_active":"2024-08-17T02:46:49.091354+0000","last_became_peered":"2024-08-17T02:46:49.091354+0000","last_unstale":"2024-08-17T02:46:49.100362+0000","last_undegraded":"2024-08-17T02:46:49.100362+0000","last_fullsized":"2024-08-17T02:46:49.100362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103996+0000","last_change":"2024-08-17T02:46:48.081234+0000","last_active":"2024-08-17T02:46:49.103996+0000","last_peered":"2024-08-17T02:46:49.103996+0000","last_clean":"2024-08-17T02:46:49.103996+0000","last_became_active":"2024-08-17T02:46:48.081039+0000","last_became_peered":"2024-08-17T02:46:48.081039+0000","last_unstale":"2024-08-17T02:46:49.103996+0000","last_undegraded":"2024-08-17T02:46:49.103996+0000","last_fullsized":"2024-08-17T02:46:49.103996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":819200,"data_stored":667426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.722}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.23}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":78040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":76578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":76614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6389999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3919999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":76488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":827392,"data_stored":667482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:58.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.407+0000 7f4fa7000640 1 Processor -- start 2024-08-17T02:46:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.407+0000 7f4fa7000640 1 -- start start 2024-08-17T02:46:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.408+0000 7f4fa7000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4fa015cb30 0x7f4fa00c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4fa7000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa00b18d0 con 0x7f4fa0158d60 2024-08-17T02:46:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4fa7000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa00b0d00 con 0x7f4fa0159130 2024-08-17T02:46:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4fa7000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00b0fa0 con 0x7f4fa015cb30 2024-08-17T02:46:58.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4fa0158d60 0x7f4fa00b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38026/0 (socket says 172.21.15.149:38026) 2024-08-17T02:46:58.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9fe00640 1 -- 172.21.15.149:0/1619380680 learned_addr learned my addr 172.21.15.149:0/1619380680 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9f400640 1 --2- 172.21.15.149:0/1619380680 >> v2:172.21.15.161:3300/0 conn(0x7f4fa015cb30 0x7f4fa00c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678047297 0 0) 0x7f4fa00b18d0 con 0x7f4fa0158d60 2024-08-17T02:46:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f840034e0 con 0x7f4fa0158d60 2024-08-17T02:46:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939698902 0 0) 0x7f4f840034e0 con 0x7f4fa0158d60 2024-08-17T02:46:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 >> v2:172.21.15.161:3300/0 conn(0x7f4fa015cb30 msgr2=0x7f4fa00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.409+0000 7f4f9ea00640 1 --2- 172.21.15.149:0/1619380680 >> v2:172.21.15.161:3300/0 conn(0x7f4fa015cb30 0x7f4fa00c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 >> v1:172.21.15.161:6789/0 conn(0x7f4fa0159130 legacy=0x7f4fa0096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00b1280 con 0x7f4fa0158d60 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f4f90001470 con 0x7f4fa0158d60 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 >> v1:172.21.15.149:6789/0 conn(0x7f4fa0158d60 legacy=0x7f4fa00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f84003a00 0x7f4f84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4f84004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f84005130 0x7f4f8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00b0fa0 con 0x7f4f84004780 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8400bff0 con 0x7f4f84003a00 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8400c1b0 con 0x7f4f84005130 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9f400640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4f84004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9fe00640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f84003a00 0x7f4f84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4fa5000640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f84005130 0x7f4f8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9f400640 1 -- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f84005130 msgr2=0x7f4f8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9f400640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f84005130 0x7f4f8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9f400640 1 -- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f84003a00 msgr2=0x7f4f84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9f400640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f84003a00 0x7f4f84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4f9f400640 1 -- 172.21.15.149:0/1619380680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840034e0 con 0x7f4f84004780 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.410+0000 7f4fa5000640 1 -- 172.21.15.149:0/1619380680 reap_dead start 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.411+0000 7f4f9f400640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4f84004bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006e70 tx=0x7f4f8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56416a75e864872f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.411+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c031400 con 0x7f4f84004780 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c02d050 con 0x7f4f84004780 2024-08-17T02:46:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4f9ea00640 1 -- 172.21.15.149:0/1619380680 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c031790 con 0x7f4f84004780 2024-08-17T02:46:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 -- 172.21.15.149:0/1619380680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 msgr2=0x7f4f84004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4f84004bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006e70 tx=0x7f4f8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 -- 172.21.15.149:0/1619380680 shutdown_connections 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 --2- 172.21.15.149:0/1619380680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4f84004bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 -- 172.21.15.149:0/1619380680 >> 172.21.15.149:0/1619380680 conn(0x7f4fa00b3040 msgr2=0x7f4fa00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 -- 172.21.15.149:0/1619380680 shutdown_connections 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.412+0000 7f4fa7000640 1 -- 172.21.15.149:0/1619380680 wait complete. 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.414+0000 7f4fa7000640 1 Processor -- start 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.414+0000 7f4fa7000640 1 -- start start 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.414+0000 7f4fa7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4fa016d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.414+0000 7f4fa7000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fa015b430 0x7f4fa0140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4fa7000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa015b880 0x7f4fa01406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4fa7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa009a020 con 0x7f4f84004780 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4fa7000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0099410 con 0x7f4fa015b880 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4fa7000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00996f0 con 0x7f4fa015b430 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4fa016d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4fa016d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44116/0 (socket says 172.21.15.149:44116) 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 -- 172.21.15.149:0/383486345 learned_addr learned my addr 172.21.15.149:0/383486345 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9f400640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fa015b430 0x7f4fa0140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4fa5000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa015b880 0x7f4fa01406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 -- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fa015b430 msgr2=0x7f4fa0140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fa015b430 0x7f4fa0140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 -- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa015b880 msgr2=0x7f4fa01406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa015b880 0x7f4fa01406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 -- 172.21.15.149:0/383486345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00999d0 con 0x7f4f84004780 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.415+0000 7f4f9fe00640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4fa016d1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004ad0 tx=0x7f4f90001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.416+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000fa90 con 0x7f4f84004780 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.416+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9000fc10 con 0x7f4f84004780 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.416+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900133f0 con 0x7f4f84004780 2024-08-17T02:46:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.416+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa0099cb0 con 0x7f4f84004780 2024-08-17T02:46:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.416+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa0099010 con 0x7f4f84004780 2024-08-17T02:46:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.417+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa00991a0 con 0x7f4f84004780 2024-08-17T02:46:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.417+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f90013760 con 0x7f4f84004780 2024-08-17T02:46:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.419+0000 7f4f97400640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4f80065180 0x7f4f80067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.419+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f90082520 con 0x7f4f84004780 2024-08-17T02:46:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.419+0000 7f4f9f400640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4f80065180 0x7f4f80067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.420+0000 7f4f9f400640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4f80065180 0x7f4f80067630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c034000 tx=0x7f4f8c035000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.423+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f90050690 con 0x7f4f84004780 2024-08-17T02:46:58.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.592+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fa009a160 con 0x7f4f80065180 2024-08-17T02:46:58.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.599+0000 7f4f97400640 1 -- 172.21.15.149:0/383486345 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264477 (secure 0 0 0) 0x7f4f8c031b00 con 0x7f4f80065180 2024-08-17T02:46:58.603 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:58.604 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:46:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4f80065180 msgr2=0x7f4f80067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4f80065180 0x7f4f80067630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c034000 tx=0x7f4f8c035000 comp rx=0 tx=0).stop 2024-08-17T02:46:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 msgr2=0x7f4fa016d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4fa016d1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004ad0 tx=0x7f4f90001e70 comp rx=0 tx=0).stop 2024-08-17T02:46:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 shutdown_connections 2024-08-17T02:46:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4f80065180 0x7f4f80067630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa015b880 0x7f4fa01406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fa015b430 0x7f4fa0140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 --2- 172.21.15.149:0/383486345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f84004780 0x7f4fa016d1e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 >> 172.21.15.149:0/383486345 conn(0x7f4fa00b3040 msgr2=0x7f4fa00c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.603+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 shutdown_connections 2024-08-17T02:46:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.604+0000 7f4fa7000640 1 -- 172.21.15.149:0/383486345 wait complete. 2024-08-17T02:46:58.619 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-08-17T02:46:57.627132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381828,"kb_used_data":2952,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592892,"statfs":{"total":773094113280,"available":770655121408,"internally_reserved":0,"allocated":3022848,"data_stored":1797316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.565830"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099636+0000","last_change":"2024-08-17T02:46:49.087269+0000","last_active":"2024-08-17T02:46:49.099636+0000","last_peered":"2024-08-17T02:46:49.099636+0000","last_clean":"2024-08-17T02:46:49.099636+0000","last_became_active":"2024-08-17T02:46:49.086977+0000","last_became_peered":"2024-08-17T02:46:49.086977+0000","last_unstale":"2024-08-17T02:46:49.099636+0000","last_undegraded":"2024-08-17T02:46:49.099636+0000","last_fullsized":"2024-08-17T02:46:49.099636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095362+0000","last_change":"2024-08-17T02:46:49.092074+0000","last_active":"2024-08-17T02:46:49.095362+0000","last_peered":"2024-08-17T02:46:49.095362+0000","last_clean":"2024-08-17T02:46:49.095362+0000","last_became_active":"2024-08-17T02:46:49.090161+0000","last_became_peered":"2024-08-17T02:46:49.090161+0000","last_unstale":"2024-08-17T02:46:49.095362+0000","last_undegraded":"2024-08-17T02:46:49.095362+0000","last_fullsized":"2024-08-17T02:46:49.095362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093760+0000","last_change":"2024-08-17T02:46:49.086579+0000","last_active":"2024-08-17T02:46:49.093760+0000","last_peered":"2024-08-17T02:46:49.093760+0000","last_clean":"2024-08-17T02:46:49.093760+0000","last_became_active":"2024-08-17T02:46:49.084975+0000","last_became_peered":"2024-08-17T02:46:49.084975+0000","last_unstale":"2024-08-17T02:46:49.093760+0000","last_undegraded":"2024-08-17T02:46:49.093760+0000","last_fullsized":"2024-08-17T02:46:49.093760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096542+0000","last_change":"2024-08-17T02:46:49.094697+0000","last_active":"2024-08-17T02:46:49.096542+0000","last_peered":"2024-08-17T02:46:49.096542+0000","last_clean":"2024-08-17T02:46:49.096542+0000","last_became_active":"2024-08-17T02:46:49.093541+0000","last_became_peered":"2024-08-17T02:46:49.093541+0000","last_unstale":"2024-08-17T02:46:49.096542+0000","last_undegraded":"2024-08-17T02:46:49.096542+0000","last_fullsized":"2024-08-17T02:46:49.096542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094318+0000","last_change":"2024-08-17T02:46:49.082685+0000","last_active":"2024-08-17T02:46:49.094318+0000","last_peered":"2024-08-17T02:46:49.094318+0000","last_clean":"2024-08-17T02:46:49.094318+0000","last_became_active":"2024-08-17T02:46:49.082382+0000","last_became_peered":"2024-08-17T02:46:49.082382+0000","last_unstale":"2024-08-17T02:46:49.094318+0000","last_undegraded":"2024-08-17T02:46:49.094318+0000","last_fullsized":"2024-08-17T02:46:49.094318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097478+0000","last_change":"2024-08-17T02:46:49.096292+0000","last_active":"2024-08-17T02:46:49.097478+0000","last_peered":"2024-08-17T02:46:49.097478+0000","last_clean":"2024-08-17T02:46:49.097478+0000","last_became_active":"2024-08-17T02:46:49.096030+0000","last_became_peered":"2024-08-17T02:46:49.096030+0000","last_unstale":"2024-08-17T02:46:49.097478+0000","last_undegraded":"2024-08-17T02:46:49.097478+0000","last_fullsized":"2024-08-17T02:46:49.097478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:49.429748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099438+0000","last_change":"2024-08-17T02:46:49.096389+0000","last_active":"2024-08-17T02:46:49.099438+0000","last_peered":"2024-08-17T02:46:49.099438+0000","last_clean":"2024-08-17T02:46:49.099438+0000","last_became_active":"2024-08-17T02:46:49.095461+0000","last_became_peered":"2024-08-17T02:46:49.095461+0000","last_unstale":"2024-08-17T02:46:49.099438+0000","last_undegraded":"2024-08-17T02:46:49.099438+0000","last_fullsized":"2024-08-17T02:46:49.099438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087502+0000","last_change":"2024-08-17T02:46:49.080927+0000","last_active":"2024-08-17T02:46:49.087502+0000","last_peered":"2024-08-17T02:46:49.087502+0000","last_clean":"2024-08-17T02:46:49.087502+0000","last_became_active":"2024-08-17T02:46:49.080697+0000","last_became_peered":"2024-08-17T02:46:49.080697+0000","last_unstale":"2024-08-17T02:46:49.087502+0000","last_undegraded":"2024-08-17T02:46:49.087502+0000","last_fullsized":"2024-08-17T02:46:49.087502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:02.889606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103298+0000","last_change":"2024-08-17T02:46:49.101464+0000","last_active":"2024-08-17T02:46:49.103298+0000","last_peered":"2024-08-17T02:46:49.103298+0000","last_clean":"2024-08-17T02:46:49.103298+0000","last_became_active":"2024-08-17T02:46:49.100349+0000","last_became_peered":"2024-08-17T02:46:49.100349+0000","last_unstale":"2024-08-17T02:46:49.103298+0000","last_undegraded":"2024-08-17T02:46:49.103298+0000","last_fullsized":"2024-08-17T02:46:49.103298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105488+0000","last_change":"2024-08-17T02:46:49.104176+0000","last_active":"2024-08-17T02:46:49.105488+0000","last_peered":"2024-08-17T02:46:49.105488+0000","last_clean":"2024-08-17T02:46:49.105488+0000","last_became_active":"2024-08-17T02:46:49.095015+0000","last_became_peered":"2024-08-17T02:46:49.095015+0000","last_unstale":"2024-08-17T02:46:49.105488+0000","last_undegraded":"2024-08-17T02:46:49.105488+0000","last_fullsized":"2024-08-17T02:46:49.105488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.085590+0000","last_change":"2024-08-17T02:46:49.082956+0000","last_active":"2024-08-17T02:46:49.085590+0000","last_peered":"2024-08-17T02:46:49.085590+0000","last_clean":"2024-08-17T02:46:49.085590+0000","last_became_active":"2024-08-17T02:46:49.080315+0000","last_became_peered":"2024-08-17T02:46:49.080315+0000","last_unstale":"2024-08-17T02:46:49.085590+0000","last_undegraded":"2024-08-17T02:46:49.085590+0000","last_fullsized":"2024-08-17T02:46:49.085590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.107656+0000","last_change":"2024-08-17T02:46:49.106327+0000","last_active":"2024-08-17T02:46:49.107656+0000","last_peered":"2024-08-17T02:46:49.107656+0000","last_clean":"2024-08-17T02:46:49.107656+0000","last_became_active":"2024-08-17T02:46:49.105995+0000","last_became_peered":"2024-08-17T02:46:49.105995+0000","last_unstale":"2024-08-17T02:46:49.107656+0000","last_undegraded":"2024-08-17T02:46:49.107656+0000","last_fullsized":"2024-08-17T02:46:49.107656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:20.150470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100233+0000","last_change":"2024-08-17T02:46:49.088848+0000","last_active":"2024-08-17T02:46:49.100233+0000","last_peered":"2024-08-17T02:46:49.100233+0000","last_clean":"2024-08-17T02:46:49.100233+0000","last_became_active":"2024-08-17T02:46:49.088404+0000","last_became_peered":"2024-08-17T02:46:49.088404+0000","last_unstale":"2024-08-17T02:46:49.100233+0000","last_undegraded":"2024-08-17T02:46:49.100233+0000","last_fullsized":"2024-08-17T02:46:49.100233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.089511+0000","last_change":"2024-08-17T02:46:49.074941+0000","last_active":"2024-08-17T02:46:49.089511+0000","last_peered":"2024-08-17T02:46:49.089511+0000","last_clean":"2024-08-17T02:46:49.089511+0000","last_became_active":"2024-08-17T02:46:49.074163+0000","last_became_peered":"2024-08-17T02:46:49.074163+0000","last_unstale":"2024-08-17T02:46:49.089511+0000","last_undegraded":"2024-08-17T02:46:49.089511+0000","last_fullsized":"2024-08-17T02:46:49.089511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086626+0000","last_change":"2024-08-17T02:46:49.081496+0000","last_active":"2024-08-17T02:46:49.086626+0000","last_peered":"2024-08-17T02:46:49.086626+0000","last_clean":"2024-08-17T02:46:49.086626+0000","last_became_active":"2024-08-17T02:46:49.081271+0000","last_became_peered":"2024-08-17T02:46:49.081271+0000","last_unstale":"2024-08-17T02:46:49.086626+0000","last_undegraded":"2024-08-17T02:46:49.086626+0000","last_fullsized":"2024-08-17T02:46:49.086626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079182+0000","last_change":"2024-08-17T02:46:49.075960+0000","last_active":"2024-08-17T02:46:49.079182+0000","last_peered":"2024-08-17T02:46:49.079182+0000","last_clean":"2024-08-17T02:46:49.079182+0000","last_became_active":"2024-08-17T02:46:49.075702+0000","last_became_peered":"2024-08-17T02:46:49.075702+0000","last_unstale":"2024-08-17T02:46:49.079182+0000","last_undegraded":"2024-08-17T02:46:49.079182+0000","last_fullsized":"2024-08-17T02:46:49.079182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093082+0000","last_change":"2024-08-17T02:46:49.090727+0000","last_active":"2024-08-17T02:46:49.093082+0000","last_peered":"2024-08-17T02:46:49.093082+0000","last_clean":"2024-08-17T02:46:49.093082+0000","last_became_active":"2024-08-17T02:46:49.090098+0000","last_became_peered":"2024-08-17T02:46:49.090098+0000","last_unstale":"2024-08-17T02:46:49.093082+0000","last_undegraded":"2024-08-17T02:46:49.093082+0000","last_fullsized":"2024-08-17T02:46:49.093082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:34.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092750+0000","last_change":"2024-08-17T02:46:49.090463+0000","last_active":"2024-08-17T02:46:49.092750+0000","last_peered":"2024-08-17T02:46:49.092750+0000","last_clean":"2024-08-17T02:46:49.092750+0000","last_became_active":"2024-08-17T02:46:49.090190+0000","last_became_peered":"2024-08-17T02:46:49.090190+0000","last_unstale":"2024-08-17T02:46:49.092750+0000","last_undegraded":"2024-08-17T02:46:49.092750+0000","last_fullsized":"2024-08-17T02:46:49.092750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:29.020704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094456+0000","last_change":"2024-08-17T02:46:49.090958+0000","last_active":"2024-08-17T02:46:49.094456+0000","last_peered":"2024-08-17T02:46:49.094456+0000","last_clean":"2024-08-17T02:46:49.094456+0000","last_became_active":"2024-08-17T02:46:49.089995+0000","last_became_peered":"2024-08-17T02:46:49.089995+0000","last_unstale":"2024-08-17T02:46:49.094456+0000","last_undegraded":"2024-08-17T02:46:49.094456+0000","last_fullsized":"2024-08-17T02:46:49.094456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105496+0000","last_change":"2024-08-17T02:46:49.087791+0000","last_active":"2024-08-17T02:46:49.105496+0000","last_peered":"2024-08-17T02:46:49.105496+0000","last_clean":"2024-08-17T02:46:49.105496+0000","last_became_active":"2024-08-17T02:46:49.087472+0000","last_became_peered":"2024-08-17T02:46:49.087472+0000","last_unstale":"2024-08-17T02:46:49.105496+0000","last_undegraded":"2024-08-17T02:46:49.105496+0000","last_fullsized":"2024-08-17T02:46:49.105496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097340+0000","last_change":"2024-08-17T02:46:49.094327+0000","last_active":"2024-08-17T02:46:49.097340+0000","last_peered":"2024-08-17T02:46:49.097340+0000","last_clean":"2024-08-17T02:46:49.097340+0000","last_became_active":"2024-08-17T02:46:49.087534+0000","last_became_peered":"2024-08-17T02:46:49.087534+0000","last_unstale":"2024-08-17T02:46:49.097340+0000","last_undegraded":"2024-08-17T02:46:49.097340+0000","last_fullsized":"2024-08-17T02:46:49.097340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092779+0000","last_change":"2024-08-17T02:46:49.086507+0000","last_active":"2024-08-17T02:46:49.092779+0000","last_peered":"2024-08-17T02:46:49.092779+0000","last_clean":"2024-08-17T02:46:49.092779+0000","last_became_active":"2024-08-17T02:46:49.086187+0000","last_became_peered":"2024-08-17T02:46:49.086187+0000","last_unstale":"2024-08-17T02:46:49.092779+0000","last_undegraded":"2024-08-17T02:46:49.092779+0000","last_fullsized":"2024-08-17T02:46:49.092779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093374+0000","last_change":"2024-08-17T02:46:49.087201+0000","last_active":"2024-08-17T02:46:49.093374+0000","last_peered":"2024-08-17T02:46:49.093374+0000","last_clean":"2024-08-17T02:46:49.093374+0000","last_became_active":"2024-08-17T02:46:49.086903+0000","last_became_peered":"2024-08-17T02:46:49.086903+0000","last_unstale":"2024-08-17T02:46:49.093374+0000","last_undegraded":"2024-08-17T02:46:49.093374+0000","last_fullsized":"2024-08-17T02:46:49.093374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:13.388708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093050+0000","last_change":"2024-08-17T02:46:49.084845+0000","last_active":"2024-08-17T02:46:49.093050+0000","last_peered":"2024-08-17T02:46:49.093050+0000","last_clean":"2024-08-17T02:46:49.093050+0000","last_became_active":"2024-08-17T02:46:49.084208+0000","last_became_peered":"2024-08-17T02:46:49.084208+0000","last_unstale":"2024-08-17T02:46:49.093050+0000","last_undegraded":"2024-08-17T02:46:49.093050+0000","last_fullsized":"2024-08-17T02:46:49.093050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:51.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100172+0000","last_change":"2024-08-17T02:46:49.088034+0000","last_active":"2024-08-17T02:46:49.100172+0000","last_peered":"2024-08-17T02:46:49.100172+0000","last_clean":"2024-08-17T02:46:49.100172+0000","last_became_active":"2024-08-17T02:46:49.085634+0000","last_became_peered":"2024-08-17T02:46:49.085634+0000","last_unstale":"2024-08-17T02:46:49.100172+0000","last_undegraded":"2024-08-17T02:46:49.100172+0000","last_fullsized":"2024-08-17T02:46:49.100172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:13.489732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104526+0000","last_change":"2024-08-17T02:46:49.093914+0000","last_active":"2024-08-17T02:46:49.104526+0000","last_peered":"2024-08-17T02:46:49.104526+0000","last_clean":"2024-08-17T02:46:49.104526+0000","last_became_active":"2024-08-17T02:46:49.093612+0000","last_became_peered":"2024-08-17T02:46:49.093612+0000","last_unstale":"2024-08-17T02:46:49.104526+0000","last_undegraded":"2024-08-17T02:46:49.104526+0000","last_fullsized":"2024-08-17T02:46:49.104526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094706+0000","last_change":"2024-08-17T02:46:49.091029+0000","last_active":"2024-08-17T02:46:49.094706+0000","last_peered":"2024-08-17T02:46:49.094706+0000","last_clean":"2024-08-17T02:46:49.094706+0000","last_became_active":"2024-08-17T02:46:49.090798+0000","last_became_peered":"2024-08-17T02:46:49.090798+0000","last_unstale":"2024-08-17T02:46:49.094706+0000","last_undegraded":"2024-08-17T02:46:49.094706+0000","last_fullsized":"2024-08-17T02:46:49.094706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103306+0000","last_change":"2024-08-17T02:46:49.097976+0000","last_active":"2024-08-17T02:46:49.103306+0000","last_peered":"2024-08-17T02:46:49.103306+0000","last_clean":"2024-08-17T02:46:49.103306+0000","last_became_active":"2024-08-17T02:46:49.095177+0000","last_became_peered":"2024-08-17T02:46:49.095177+0000","last_unstale":"2024-08-17T02:46:49.103306+0000","last_undegraded":"2024-08-17T02:46:49.103306+0000","last_fullsized":"2024-08-17T02:46:49.103306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.269002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097796+0000","last_change":"2024-08-17T02:46:49.094891+0000","last_active":"2024-08-17T02:46:49.097796+0000","last_peered":"2024-08-17T02:46:49.097796+0000","last_clean":"2024-08-17T02:46:49.097796+0000","last_became_active":"2024-08-17T02:46:49.094626+0000","last_became_peered":"2024-08-17T02:46:49.094626+0000","last_unstale":"2024-08-17T02:46:49.097796+0000","last_undegraded":"2024-08-17T02:46:49.097796+0000","last_fullsized":"2024-08-17T02:46:49.097796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:11.753714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.092753+0000","last_change":"2024-08-17T02:46:49.085872+0000","last_active":"2024-08-17T02:46:49.092753+0000","last_peered":"2024-08-17T02:46:49.092753+0000","last_clean":"2024-08-17T02:46:49.092753+0000","last_became_active":"2024-08-17T02:46:49.085620+0000","last_became_peered":"2024-08-17T02:46:49.085620+0000","last_unstale":"2024-08-17T02:46:49.092753+0000","last_undegraded":"2024-08-17T02:46:49.092753+0000","last_fullsized":"2024-08-17T02:46:49.092753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:14.062485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087104+0000","last_change":"2024-08-17T02:46:49.079133+0000","last_active":"2024-08-17T02:46:49.087104+0000","last_peered":"2024-08-17T02:46:49.087104+0000","last_clean":"2024-08-17T02:46:49.087104+0000","last_became_active":"2024-08-17T02:46:49.078405+0000","last_became_peered":"2024-08-17T02:46:49.078405+0000","last_unstale":"2024-08-17T02:46:49.087104+0000","last_undegraded":"2024-08-17T02:46:49.087104+0000","last_fullsized":"2024-08-17T02:46:49.087104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:57.922654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.107061+0000","last_change":"2024-08-17T02:46:49.105591+0000","last_active":"2024-08-17T02:46:49.107061+0000","last_peered":"2024-08-17T02:46:49.107061+0000","last_clean":"2024-08-17T02:46:49.107061+0000","last_became_active":"2024-08-17T02:46:49.104220+0000","last_became_peered":"2024-08-17T02:46:49.104220+0000","last_unstale":"2024-08-17T02:46:49.107061+0000","last_undegraded":"2024-08-17T02:46:49.107061+0000","last_fullsized":"2024-08-17T02:46:49.107061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:04:18.048242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.078562+0000","last_change":"2024-08-17T02:46:49.072690+0000","last_active":"2024-08-17T02:46:49.078562+0000","last_peered":"2024-08-17T02:46:49.078562+0000","last_clean":"2024-08-17T02:46:49.078562+0000","last_became_active":"2024-08-17T02:46:49.072424+0000","last_became_peered":"2024-08-17T02:46:49.072424+0000","last_unstale":"2024-08-17T02:46:49.078562+0000","last_undegraded":"2024-08-17T02:46:49.078562+0000","last_fullsized":"2024-08-17T02:46:49.078562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:35.318940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099753+0000","last_change":"2024-08-17T02:46:48.085210+0000","last_active":"2024-08-17T02:46:49.099753+0000","last_peered":"2024-08-17T02:46:49.099753+0000","last_clean":"2024-08-17T02:46:49.099753+0000","last_became_active":"2024-08-17T02:46:48.084916+0000","last_became_peered":"2024-08-17T02:46:48.084916+0000","last_unstale":"2024-08-17T02:46:49.099753+0000","last_undegraded":"2024-08-17T02:46:49.099753+0000","last_fullsized":"2024-08-17T02:46:49.099753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087321+0000","last_change":"2024-08-17T02:46:49.080439+0000","last_active":"2024-08-17T02:46:49.087321+0000","last_peered":"2024-08-17T02:46:49.087321+0000","last_clean":"2024-08-17T02:46:49.087321+0000","last_became_active":"2024-08-17T02:46:49.080211+0000","last_became_peered":"2024-08-17T02:46:49.080211+0000","last_unstale":"2024-08-17T02:46:49.087321+0000","last_undegraded":"2024-08-17T02:46:49.087321+0000","last_fullsized":"2024-08-17T02:46:49.087321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.105019+0000","last_change":"2024-08-17T02:46:48.090901+0000","last_active":"2024-08-17T02:46:49.105019+0000","last_peered":"2024-08-17T02:46:49.105019+0000","last_clean":"2024-08-17T02:46:49.105019+0000","last_became_active":"2024-08-17T02:46:48.089868+0000","last_became_peered":"2024-08-17T02:46:48.089868+0000","last_unstale":"2024-08-17T02:46:49.105019+0000","last_undegraded":"2024-08-17T02:46:49.105019+0000","last_fullsized":"2024-08-17T02:46:49.105019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079910+0000","last_change":"2024-08-17T02:46:48.076568+0000","last_active":"2024-08-17T02:46:49.079910+0000","last_peered":"2024-08-17T02:46:49.079910+0000","last_clean":"2024-08-17T02:46:49.079910+0000","last_became_active":"2024-08-17T02:46:48.076238+0000","last_became_peered":"2024-08-17T02:46:48.076238+0000","last_unstale":"2024-08-17T02:46:49.079910+0000","last_undegraded":"2024-08-17T02:46:49.079910+0000","last_fullsized":"2024-08-17T02:46:49.079910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103277+0000","last_change":"2024-08-17T02:46:49.095963+0000","last_active":"2024-08-17T02:46:49.103277+0000","last_peered":"2024-08-17T02:46:49.103277+0000","last_clean":"2024-08-17T02:46:49.103277+0000","last_became_active":"2024-08-17T02:46:49.095697+0000","last_became_peered":"2024-08-17T02:46:49.095697+0000","last_unstale":"2024-08-17T02:46:49.103277+0000","last_undegraded":"2024-08-17T02:46:49.103277+0000","last_fullsized":"2024-08-17T02:46:49.103277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066816+0000","last_change":"2024-08-17T02:46:48.090123+0000","last_active":"2024-08-17T02:46:49.066816+0000","last_peered":"2024-08-17T02:46:49.066816+0000","last_clean":"2024-08-17T02:46:49.066816+0000","last_became_active":"2024-08-17T02:46:48.089137+0000","last_became_peered":"2024-08-17T02:46:48.089137+0000","last_unstale":"2024-08-17T02:46:49.066816+0000","last_undegraded":"2024-08-17T02:46:49.066816+0000","last_fullsized":"2024-08-17T02:46:49.066816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094584+0000","last_change":"2024-08-17T02:46:49.086912+0000","last_active":"2024-08-17T02:46:49.094584+0000","last_peered":"2024-08-17T02:46:49.094584+0000","last_clean":"2024-08-17T02:46:49.094584+0000","last_became_active":"2024-08-17T02:46:49.086607+0000","last_became_peered":"2024-08-17T02:46:49.086607+0000","last_unstale":"2024-08-17T02:46:49.094584+0000","last_undegraded":"2024-08-17T02:46:49.094584+0000","last_fullsized":"2024-08-17T02:46:49.094584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:28.509909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071998+0000","last_change":"2024-08-17T02:46:48.082227+0000","last_active":"2024-08-17T02:46:49.071998+0000","last_peered":"2024-08-17T02:46:49.071998+0000","last_clean":"2024-08-17T02:46:49.071998+0000","last_became_active":"2024-08-17T02:46:48.081670+0000","last_became_peered":"2024-08-17T02:46:48.081670+0000","last_unstale":"2024-08-17T02:46:49.071998+0000","last_undegraded":"2024-08-17T02:46:49.071998+0000","last_fullsized":"2024-08-17T02:46:49.071998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093016+0000","last_change":"2024-08-17T02:46:49.089798+0000","last_active":"2024-08-17T02:46:49.093016+0000","last_peered":"2024-08-17T02:46:49.093016+0000","last_clean":"2024-08-17T02:46:49.093016+0000","last_became_active":"2024-08-17T02:46:49.088859+0000","last_became_peered":"2024-08-17T02:46:49.088859+0000","last_unstale":"2024-08-17T02:46:49.093016+0000","last_undegraded":"2024-08-17T02:46:49.093016+0000","last_fullsized":"2024-08-17T02:46:49.093016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.067403+0000","last_change":"2024-08-17T02:46:48.075698+0000","last_active":"2024-08-17T02:46:49.067403+0000","last_peered":"2024-08-17T02:46:49.067403+0000","last_clean":"2024-08-17T02:46:49.067403+0000","last_became_active":"2024-08-17T02:46:48.075409+0000","last_became_peered":"2024-08-17T02:46:48.075409+0000","last_unstale":"2024-08-17T02:46:49.067403+0000","last_undegraded":"2024-08-17T02:46:49.067403+0000","last_fullsized":"2024-08-17T02:46:49.067403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094421+0000","last_change":"2024-08-17T02:46:49.090547+0000","last_active":"2024-08-17T02:46:49.094421+0000","last_peered":"2024-08-17T02:46:49.094421+0000","last_clean":"2024-08-17T02:46:49.094421+0000","last_became_active":"2024-08-17T02:46:49.090316+0000","last_became_peered":"2024-08-17T02:46:49.090316+0000","last_unstale":"2024-08-17T02:46:49.094421+0000","last_undegraded":"2024-08-17T02:46:49.094421+0000","last_fullsized":"2024-08-17T02:46:49.094421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:35.606756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097432+0000","last_change":"2024-08-17T02:46:48.079760+0000","last_active":"2024-08-17T02:46:49.097432+0000","last_peered":"2024-08-17T02:46:49.097432+0000","last_clean":"2024-08-17T02:46:49.097432+0000","last_became_active":"2024-08-17T02:46:48.079517+0000","last_became_peered":"2024-08-17T02:46:48.079517+0000","last_unstale":"2024-08-17T02:46:49.097432+0000","last_undegraded":"2024-08-17T02:46:49.097432+0000","last_fullsized":"2024-08-17T02:46:49.097432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:10:17.014457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097729+0000","last_change":"2024-08-17T02:46:49.091777+0000","last_active":"2024-08-17T02:46:49.097729+0000","last_peered":"2024-08-17T02:46:49.097729+0000","last_clean":"2024-08-17T02:46:49.097729+0000","last_became_active":"2024-08-17T02:46:49.085179+0000","last_became_peered":"2024-08-17T02:46:49.085179+0000","last_unstale":"2024-08-17T02:46:49.097729+0000","last_undegraded":"2024-08-17T02:46:49.097729+0000","last_fullsized":"2024-08-17T02:46:49.097729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:28.274012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.113032+0000","last_change":"2024-08-17T02:46:48.080838+0000","last_active":"2024-08-17T02:46:49.113032+0000","last_peered":"2024-08-17T02:46:49.113032+0000","last_clean":"2024-08-17T02:46:49.113032+0000","last_became_active":"2024-08-17T02:46:48.080291+0000","last_became_peered":"2024-08-17T02:46:48.080291+0000","last_unstale":"2024-08-17T02:46:49.113032+0000","last_undegraded":"2024-08-17T02:46:49.113032+0000","last_fullsized":"2024-08-17T02:46:49.113032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094435+0000","last_change":"2024-08-17T02:46:49.088724+0000","last_active":"2024-08-17T02:46:49.094435+0000","last_peered":"2024-08-17T02:46:49.094435+0000","last_clean":"2024-08-17T02:46:49.094435+0000","last_became_active":"2024-08-17T02:46:49.088123+0000","last_became_peered":"2024-08-17T02:46:49.088123+0000","last_unstale":"2024-08-17T02:46:49.094435+0000","last_undegraded":"2024-08-17T02:46:49.094435+0000","last_fullsized":"2024-08-17T02:46:49.094435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.102422+0000","last_change":"2024-08-17T02:46:48.091037+0000","last_active":"2024-08-17T02:46:49.102422+0000","last_peered":"2024-08-17T02:46:49.102422+0000","last_clean":"2024-08-17T02:46:49.102422+0000","last_became_active":"2024-08-17T02:46:48.090779+0000","last_became_peered":"2024-08-17T02:46:48.090779+0000","last_unstale":"2024-08-17T02:46:49.102422+0000","last_undegraded":"2024-08-17T02:46:49.102422+0000","last_fullsized":"2024-08-17T02:46:49.102422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:28.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094625+0000","last_change":"2024-08-17T02:46:49.089937+0000","last_active":"2024-08-17T02:46:49.094625+0000","last_peered":"2024-08-17T02:46:49.094625+0000","last_clean":"2024-08-17T02:46:49.094625+0000","last_became_active":"2024-08-17T02:46:49.089635+0000","last_became_peered":"2024-08-17T02:46:49.089635+0000","last_unstale":"2024-08-17T02:46:49.094625+0000","last_undegraded":"2024-08-17T02:46:49.094625+0000","last_fullsized":"2024-08-17T02:46:49.094625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068360+0000","last_change":"2024-08-17T02:46:48.078674+0000","last_active":"2024-08-17T02:46:49.068360+0000","last_peered":"2024-08-17T02:46:49.068360+0000","last_clean":"2024-08-17T02:46:49.068360+0000","last_became_active":"2024-08-17T02:46:48.078254+0000","last_became_peered":"2024-08-17T02:46:48.078254+0000","last_unstale":"2024-08-17T02:46:49.068360+0000","last_undegraded":"2024-08-17T02:46:49.068360+0000","last_fullsized":"2024-08-17T02:46:49.068360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094338+0000","last_change":"2024-08-17T02:46:49.083382+0000","last_active":"2024-08-17T02:46:49.094338+0000","last_peered":"2024-08-17T02:46:49.094338+0000","last_clean":"2024-08-17T02:46:49.094338+0000","last_became_active":"2024-08-17T02:46:49.083117+0000","last_became_peered":"2024-08-17T02:46:49.083117+0000","last_unstale":"2024-08-17T02:46:49.094338+0000","last_undegraded":"2024-08-17T02:46:49.094338+0000","last_fullsized":"2024-08-17T02:46:49.094338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:19.375878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.072280+0000","last_change":"2024-08-17T02:46:48.090201+0000","last_active":"2024-08-17T02:46:49.072280+0000","last_peered":"2024-08-17T02:46:49.072280+0000","last_clean":"2024-08-17T02:46:49.072280+0000","last_became_active":"2024-08-17T02:46:48.088890+0000","last_became_peered":"2024-08-17T02:46:48.088890+0000","last_unstale":"2024-08-17T02:46:49.072280+0000","last_undegraded":"2024-08-17T02:46:49.072280+0000","last_fullsized":"2024-08-17T02:46:49.072280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:52.864560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.107083+0000","last_change":"2024-08-17T02:46:49.105595+0000","last_active":"2024-08-17T02:46:49.107083+0000","last_peered":"2024-08-17T02:46:49.107083+0000","last_clean":"2024-08-17T02:46:49.107083+0000","last_became_active":"2024-08-17T02:46:49.104413+0000","last_became_peered":"2024-08-17T02:46:49.104413+0000","last_unstale":"2024-08-17T02:46:49.107083+0000","last_undegraded":"2024-08-17T02:46:49.107083+0000","last_fullsized":"2024-08-17T02:46:49.107083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:38.041373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.096457+0000","last_change":"2024-08-17T02:46:48.078982+0000","last_active":"2024-08-17T02:46:49.096457+0000","last_peered":"2024-08-17T02:46:49.096457+0000","last_clean":"2024-08-17T02:46:49.096457+0000","last_became_active":"2024-08-17T02:46:48.078749+0000","last_became_peered":"2024-08-17T02:46:48.078749+0000","last_unstale":"2024-08-17T02:46:49.096457+0000","last_undegraded":"2024-08-17T02:46:49.096457+0000","last_fullsized":"2024-08-17T02:46:49.096457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.090546+0000","last_change":"2024-08-17T02:46:49.082500+0000","last_active":"2024-08-17T02:46:49.090546+0000","last_peered":"2024-08-17T02:46:49.090546+0000","last_clean":"2024-08-17T02:46:49.090546+0000","last_became_active":"2024-08-17T02:46:49.081473+0000","last_became_peered":"2024-08-17T02:46:49.081473+0000","last_unstale":"2024-08-17T02:46:49.090546+0000","last_undegraded":"2024-08-17T02:46:49.090546+0000","last_fullsized":"2024-08-17T02:46:49.090546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:36.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.099263+0000","last_change":"2024-08-17T02:46:48.087651+0000","last_active":"2024-08-17T02:46:49.099263+0000","last_peered":"2024-08-17T02:46:49.099263+0000","last_clean":"2024-08-17T02:46:49.099263+0000","last_became_active":"2024-08-17T02:46:48.086669+0000","last_became_peered":"2024-08-17T02:46:48.086669+0000","last_unstale":"2024-08-17T02:46:49.099263+0000","last_undegraded":"2024-08-17T02:46:49.099263+0000","last_fullsized":"2024-08-17T02:46:49.099263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:51.853156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.091076+0000","last_change":"2024-08-17T02:46:49.083492+0000","last_active":"2024-08-17T02:46:49.091076+0000","last_peered":"2024-08-17T02:46:49.091076+0000","last_clean":"2024-08-17T02:46:49.091076+0000","last_became_active":"2024-08-17T02:46:49.083219+0000","last_became_peered":"2024-08-17T02:46:49.083219+0000","last_unstale":"2024-08-17T02:46:49.091076+0000","last_undegraded":"2024-08-17T02:46:49.091076+0000","last_fullsized":"2024-08-17T02:46:49.091076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087839+0000","last_change":"2024-08-17T02:46:48.077491+0000","last_active":"2024-08-17T02:46:49.087839+0000","last_peered":"2024-08-17T02:46:49.087839+0000","last_clean":"2024-08-17T02:46:49.087839+0000","last_became_active":"2024-08-17T02:46:48.076811+0000","last_became_peered":"2024-08-17T02:46:48.076811+0000","last_unstale":"2024-08-17T02:46:49.087839+0000","last_undegraded":"2024-08-17T02:46:49.087839+0000","last_fullsized":"2024-08-17T02:46:49.087839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103569+0000","last_change":"2024-08-17T02:46:49.101717+0000","last_active":"2024-08-17T02:46:49.103569+0000","last_peered":"2024-08-17T02:46:49.103569+0000","last_clean":"2024-08-17T02:46:49.103569+0000","last_became_active":"2024-08-17T02:46:49.101402+0000","last_became_peered":"2024-08-17T02:46:49.101402+0000","last_unstale":"2024-08-17T02:46:49.103569+0000","last_undegraded":"2024-08-17T02:46:49.103569+0000","last_fullsized":"2024-08-17T02:46:49.103569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:31.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.097911+0000","last_change":"2024-08-17T02:46:48.088763+0000","last_active":"2024-08-17T02:46:49.097911+0000","last_peered":"2024-08-17T02:46:49.097911+0000","last_clean":"2024-08-17T02:46:49.097911+0000","last_became_active":"2024-08-17T02:46:48.088515+0000","last_became_peered":"2024-08-17T02:46:48.088515+0000","last_unstale":"2024-08-17T02:46:49.097911+0000","last_undegraded":"2024-08-17T02:46:49.097911+0000","last_fullsized":"2024-08-17T02:46:49.097911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:47.407554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095108+0000","last_change":"2024-08-17T02:46:49.091638+0000","last_active":"2024-08-17T02:46:49.095108+0000","last_peered":"2024-08-17T02:46:49.095108+0000","last_clean":"2024-08-17T02:46:49.095108+0000","last_became_active":"2024-08-17T02:46:49.091395+0000","last_became_peered":"2024-08-17T02:46:49.091395+0000","last_unstale":"2024-08-17T02:46:49.095108+0000","last_undegraded":"2024-08-17T02:46:49.095108+0000","last_fullsized":"2024-08-17T02:46:49.095108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:16.992760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071417+0000","last_change":"2024-08-17T02:46:48.081129+0000","last_active":"2024-08-17T02:46:49.071417+0000","last_peered":"2024-08-17T02:46:49.071417+0000","last_clean":"2024-08-17T02:46:49.071417+0000","last_became_active":"2024-08-17T02:46:48.080849+0000","last_became_peered":"2024-08-17T02:46:48.080849+0000","last_unstale":"2024-08-17T02:46:49.071417+0000","last_undegraded":"2024-08-17T02:46:49.071417+0000","last_fullsized":"2024-08-17T02:46:49.071417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:37.122554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103233+0000","last_change":"2024-08-17T02:46:49.100757+0000","last_active":"2024-08-17T02:46:49.103233+0000","last_peered":"2024-08-17T02:46:49.103233+0000","last_clean":"2024-08-17T02:46:49.103233+0000","last_became_active":"2024-08-17T02:46:49.100157+0000","last_became_peered":"2024-08-17T02:46:49.100157+0000","last_unstale":"2024-08-17T02:46:49.103233+0000","last_undegraded":"2024-08-17T02:46:49.103233+0000","last_fullsized":"2024-08-17T02:46:49.103233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:11.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.070174+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:46:49.070174+0000","last_peered":"2024-08-17T02:46:49.070174+0000","last_clean":"2024-08-17T02:46:49.070174+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:46:49.070174+0000","last_undegraded":"2024-08-17T02:46:49.070174+0000","last_fullsized":"2024-08-17T02:46:49.070174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.066868+0000","last_change":"2024-08-17T02:46:48.079170+0000","last_active":"2024-08-17T02:46:49.066868+0000","last_peered":"2024-08-17T02:46:49.066868+0000","last_clean":"2024-08-17T02:46:49.066868+0000","last_became_active":"2024-08-17T02:46:48.078398+0000","last_became_peered":"2024-08-17T02:46:48.078398+0000","last_unstale":"2024-08-17T02:46:49.066868+0000","last_undegraded":"2024-08-17T02:46:49.066868+0000","last_fullsized":"2024-08-17T02:46:49.066868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.087841+0000","last_change":"2024-08-17T02:46:49.083909+0000","last_active":"2024-08-17T02:46:49.087841+0000","last_peered":"2024-08-17T02:46:49.087841+0000","last_clean":"2024-08-17T02:46:49.087841+0000","last_became_active":"2024-08-17T02:46:49.083625+0000","last_became_peered":"2024-08-17T02:46:49.083625+0000","last_unstale":"2024-08-17T02:46:49.087841+0000","last_undegraded":"2024-08-17T02:46:49.087841+0000","last_fullsized":"2024-08-17T02:46:49.087841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:36.672843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.070091+0000","last_change":"2024-08-17T02:46:48.091863+0000","last_active":"2024-08-17T02:46:49.070091+0000","last_peered":"2024-08-17T02:46:49.070091+0000","last_clean":"2024-08-17T02:46:49.070091+0000","last_became_active":"2024-08-17T02:46:48.091526+0000","last_became_peered":"2024-08-17T02:46:48.091526+0000","last_unstale":"2024-08-17T02:46:49.070091+0000","last_undegraded":"2024-08-17T02:46:49.070091+0000","last_fullsized":"2024-08-17T02:46:49.070091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:27.266794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.093823+0000","last_change":"2024-08-17T02:46:49.087183+0000","last_active":"2024-08-17T02:46:49.093823+0000","last_peered":"2024-08-17T02:46:49.093823+0000","last_clean":"2024-08-17T02:46:49.093823+0000","last_became_active":"2024-08-17T02:46:49.086849+0000","last_became_peered":"2024-08-17T02:46:49.086849+0000","last_unstale":"2024-08-17T02:46:49.093823+0000","last_undegraded":"2024-08-17T02:46:49.093823+0000","last_fullsized":"2024-08-17T02:46:49.093823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:14.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.071993+0000","last_change":"2024-08-17T02:46:48.084642+0000","last_active":"2024-08-17T02:46:49.071993+0000","last_peered":"2024-08-17T02:46:49.071993+0000","last_clean":"2024-08-17T02:46:49.071993+0000","last_became_active":"2024-08-17T02:46:48.084341+0000","last_became_peered":"2024-08-17T02:46:48.084341+0000","last_unstale":"2024-08-17T02:46:49.071993+0000","last_undegraded":"2024-08-17T02:46:49.071993+0000","last_fullsized":"2024-08-17T02:46:49.071993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:56.342528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095221+0000","last_change":"2024-08-17T02:46:49.088066+0000","last_active":"2024-08-17T02:46:49.095221+0000","last_peered":"2024-08-17T02:46:49.095221+0000","last_clean":"2024-08-17T02:46:49.095221+0000","last_became_active":"2024-08-17T02:46:49.084322+0000","last_became_peered":"2024-08-17T02:46:49.084322+0000","last_unstale":"2024-08-17T02:46:49.095221+0000","last_undegraded":"2024-08-17T02:46:49.095221+0000","last_fullsized":"2024-08-17T02:46:49.095221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:10.275645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.068469+0000","last_change":"2024-08-17T02:46:48.081051+0000","last_active":"2024-08-17T02:46:49.068469+0000","last_peered":"2024-08-17T02:46:49.068469+0000","last_clean":"2024-08-17T02:46:49.068469+0000","last_became_active":"2024-08-17T02:46:48.080649+0000","last_became_peered":"2024-08-17T02:46:48.080649+0000","last_unstale":"2024-08-17T02:46:49.068469+0000","last_undegraded":"2024-08-17T02:46:49.068469+0000","last_fullsized":"2024-08-17T02:46:49.068469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.098061+0000","last_change":"2024-08-17T02:46:49.094024+0000","last_active":"2024-08-17T02:46:49.098061+0000","last_peered":"2024-08-17T02:46:49.098061+0000","last_clean":"2024-08-17T02:46:49.098061+0000","last_became_active":"2024-08-17T02:46:49.093680+0000","last_became_peered":"2024-08-17T02:46:49.093680+0000","last_unstale":"2024-08-17T02:46:49.098061+0000","last_undegraded":"2024-08-17T02:46:49.098061+0000","last_fullsized":"2024-08-17T02:46:49.098061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:57.304010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063798+0000","last_change":"2024-08-17T02:46:48.078992+0000","last_active":"2024-08-17T02:46:49.063798+0000","last_peered":"2024-08-17T02:46:49.063798+0000","last_clean":"2024-08-17T02:46:49.063798+0000","last_became_active":"2024-08-17T02:46:48.078756+0000","last_became_peered":"2024-08-17T02:46:48.078756+0000","last_unstale":"2024-08-17T02:46:49.063798+0000","last_undegraded":"2024-08-17T02:46:49.063798+0000","last_fullsized":"2024-08-17T02:46:49.063798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:54.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.095301+0000","last_change":"2024-08-17T02:46:49.088373+0000","last_active":"2024-08-17T02:46:49.095301+0000","last_peered":"2024-08-17T02:46:49.095301+0000","last_clean":"2024-08-17T02:46:49.095301+0000","last_became_active":"2024-08-17T02:46:49.087461+0000","last_became_peered":"2024-08-17T02:46:49.087461+0000","last_unstale":"2024-08-17T02:46:49.095301+0000","last_undegraded":"2024-08-17T02:46:49.095301+0000","last_fullsized":"2024-08-17T02:46:49.095301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:53.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.076647+0000","last_change":"2024-08-17T02:46:48.089957+0000","last_active":"2024-08-17T02:46:49.076647+0000","last_peered":"2024-08-17T02:46:49.076647+0000","last_clean":"2024-08-17T02:46:49.076647+0000","last_became_active":"2024-08-17T02:46:48.089649+0000","last_became_peered":"2024-08-17T02:46:48.089649+0000","last_unstale":"2024-08-17T02:46:49.076647+0000","last_undegraded":"2024-08-17T02:46:49.076647+0000","last_fullsized":"2024-08-17T02:46:49.076647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.143252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.083036+0000","last_change":"2024-08-17T02:46:49.078454+0000","last_active":"2024-08-17T02:46:49.083036+0000","last_peered":"2024-08-17T02:46:49.083036+0000","last_clean":"2024-08-17T02:46:49.083036+0000","last_became_active":"2024-08-17T02:46:49.078210+0000","last_became_peered":"2024-08-17T02:46:49.078210+0000","last_unstale":"2024-08-17T02:46:49.083036+0000","last_undegraded":"2024-08-17T02:46:49.083036+0000","last_fullsized":"2024-08-17T02:46:49.083036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:46:50.082936+0000","last_change":"2024-08-17T02:46:48.077368+0000","last_active":"2024-08-17T02:46:50.082936+0000","last_peered":"2024-08-17T02:46:50.082936+0000","last_clean":"2024-08-17T02:46:50.082936+0000","last_became_active":"2024-08-17T02:46:48.077133+0000","last_became_peered":"2024-08-17T02:46:48.077133+0000","last_unstale":"2024-08-17T02:46:50.082936+0000","last_undegraded":"2024-08-17T02:46:50.082936+0000","last_fullsized":"2024-08-17T02:46:50.082936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103611+0000","last_change":"2024-08-17T02:46:49.101882+0000","last_active":"2024-08-17T02:46:49.103611+0000","last_peered":"2024-08-17T02:46:49.103611+0000","last_clean":"2024-08-17T02:46:49.103611+0000","last_became_active":"2024-08-17T02:46:49.101646+0000","last_became_peered":"2024-08-17T02:46:49.101646+0000","last_unstale":"2024-08-17T02:46:49.103611+0000","last_undegraded":"2024-08-17T02:46:49.103611+0000","last_fullsized":"2024-08-17T02:46:49.103611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:12.470463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104030+0000","last_change":"2024-08-17T02:46:48.081324+0000","last_active":"2024-08-17T02:46:49.104030+0000","last_peered":"2024-08-17T02:46:49.104030+0000","last_clean":"2024-08-17T02:46:49.104030+0000","last_became_active":"2024-08-17T02:46:48.078219+0000","last_became_peered":"2024-08-17T02:46:48.078219+0000","last_unstale":"2024-08-17T02:46:49.104030+0000","last_undegraded":"2024-08-17T02:46:49.104030+0000","last_fullsized":"2024-08-17T02:46:49.104030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.086252+0000","last_change":"2024-08-17T02:46:49.081991+0000","last_active":"2024-08-17T02:46:49.086252+0000","last_peered":"2024-08-17T02:46:49.086252+0000","last_clean":"2024-08-17T02:46:49.086252+0000","last_became_active":"2024-08-17T02:46:49.081605+0000","last_became_peered":"2024-08-17T02:46:49.081605+0000","last_unstale":"2024-08-17T02:46:49.086252+0000","last_undegraded":"2024-08-17T02:46:49.086252+0000","last_fullsized":"2024-08-17T02:46:49.086252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:09.169449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.070006+0000","last_change":"2024-08-17T02:46:48.087420+0000","last_active":"2024-08-17T02:46:49.070006+0000","last_peered":"2024-08-17T02:46:49.070006+0000","last_clean":"2024-08-17T02:46:49.070006+0000","last_became_active":"2024-08-17T02:46:48.087176+0000","last_became_peered":"2024-08-17T02:46:48.087176+0000","last_unstale":"2024-08-17T02:46:49.070006+0000","last_undegraded":"2024-08-17T02:46:49.070006+0000","last_fullsized":"2024-08-17T02:46:49.070006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:56.296792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080285+0000","last_change":"2024-08-17T02:46:49.079248+0000","last_active":"2024-08-17T02:46:49.080285+0000","last_peered":"2024-08-17T02:46:49.080285+0000","last_clean":"2024-08-17T02:46:49.080285+0000","last_became_active":"2024-08-17T02:46:49.078901+0000","last_became_peered":"2024-08-17T02:46:49.078901+0000","last_unstale":"2024-08-17T02:46:49.080285+0000","last_undegraded":"2024-08-17T02:46:49.080285+0000","last_fullsized":"2024-08-17T02:46:49.080285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:41.552959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063585+0000","last_change":"2024-08-17T02:46:48.087189+0000","last_active":"2024-08-17T02:46:49.063585+0000","last_peered":"2024-08-17T02:46:49.063585+0000","last_clean":"2024-08-17T02:46:49.063585+0000","last_became_active":"2024-08-17T02:46:48.086418+0000","last_became_peered":"2024-08-17T02:46:48.086418+0000","last_unstale":"2024-08-17T02:46:49.063585+0000","last_undegraded":"2024-08-17T02:46:49.063585+0000","last_fullsized":"2024-08-17T02:46:49.063585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:56.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.085453+0000","last_change":"2024-08-17T02:46:49.080433+0000","last_active":"2024-08-17T02:46:49.085453+0000","last_peered":"2024-08-17T02:46:49.085453+0000","last_clean":"2024-08-17T02:46:49.085453+0000","last_became_active":"2024-08-17T02:46:49.080054+0000","last_became_peered":"2024-08-17T02:46:49.080054+0000","last_unstale":"2024-08-17T02:46:49.085453+0000","last_undegraded":"2024-08-17T02:46:49.085453+0000","last_fullsized":"2024-08-17T02:46:49.085453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:16.372699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.063075+0000","last_change":"2024-08-17T02:46:48.077229+0000","last_active":"2024-08-17T02:46:49.063075+0000","last_peered":"2024-08-17T02:46:49.063075+0000","last_clean":"2024-08-17T02:46:49.063075+0000","last_became_active":"2024-08-17T02:46:48.076984+0000","last_became_peered":"2024-08-17T02:46:48.076984+0000","last_unstale":"2024-08-17T02:46:49.063075+0000","last_undegraded":"2024-08-17T02:46:49.063075+0000","last_fullsized":"2024-08-17T02:46:49.063075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:24.707410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103538+0000","last_change":"2024-08-17T02:46:49.098807+0000","last_active":"2024-08-17T02:46:49.103538+0000","last_peered":"2024-08-17T02:46:49.103538+0000","last_clean":"2024-08-17T02:46:49.103538+0000","last_became_active":"2024-08-17T02:46:49.098544+0000","last_became_peered":"2024-08-17T02:46:49.098544+0000","last_unstale":"2024-08-17T02:46:49.103538+0000","last_undegraded":"2024-08-17T02:46:49.103538+0000","last_fullsized":"2024-08-17T02:46:49.103538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:07.063778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103214+0000","last_change":"2024-08-17T02:46:48.093596+0000","last_active":"2024-08-17T02:46:49.103214+0000","last_peered":"2024-08-17T02:46:49.103214+0000","last_clean":"2024-08-17T02:46:49.103214+0000","last_became_active":"2024-08-17T02:46:48.093268+0000","last_became_peered":"2024-08-17T02:46:48.093268+0000","last_unstale":"2024-08-17T02:46:49.103214+0000","last_undegraded":"2024-08-17T02:46:49.103214+0000","last_fullsized":"2024-08-17T02:46:49.103214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:45.820290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103393+0000","last_change":"2024-08-17T02:46:49.082223+0000","last_active":"2024-08-17T02:46:49.103393+0000","last_peered":"2024-08-17T02:46:49.103393+0000","last_clean":"2024-08-17T02:46:49.103393+0000","last_became_active":"2024-08-17T02:46:49.081793+0000","last_became_peered":"2024-08-17T02:46:49.081793+0000","last_unstale":"2024-08-17T02:46:49.103393+0000","last_undegraded":"2024-08-17T02:46:49.103393+0000","last_fullsized":"2024-08-17T02:46:49.103393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.079110+0000","last_change":"2024-08-17T02:46:49.074753+0000","last_active":"2024-08-17T02:46:49.079110+0000","last_peered":"2024-08-17T02:46:49.079110+0000","last_clean":"2024-08-17T02:46:49.079110+0000","last_became_active":"2024-08-17T02:46:49.074319+0000","last_became_peered":"2024-08-17T02:46:49.074319+0000","last_unstale":"2024-08-17T02:46:49.079110+0000","last_undegraded":"2024-08-17T02:46:49.079110+0000","last_fullsized":"2024-08-17T02:46:49.079110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:31.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104043+0000","last_change":"2024-08-17T02:46:48.091988+0000","last_active":"2024-08-17T02:46:49.104043+0000","last_peered":"2024-08-17T02:46:49.104043+0000","last_clean":"2024-08-17T02:46:49.104043+0000","last_became_active":"2024-08-17T02:46:48.091617+0000","last_became_peered":"2024-08-17T02:46:48.091617+0000","last_unstale":"2024-08-17T02:46:49.104043+0000","last_undegraded":"2024-08-17T02:46:49.104043+0000","last_fullsized":"2024-08-17T02:46:49.104043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:52.521632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.080144+0000","last_change":"2024-08-17T02:46:49.078397+0000","last_active":"2024-08-17T02:46:49.080144+0000","last_peered":"2024-08-17T02:46:49.080144+0000","last_clean":"2024-08-17T02:46:49.080144+0000","last_became_active":"2024-08-17T02:46:49.078122+0000","last_became_peered":"2024-08-17T02:46:49.078122+0000","last_unstale":"2024-08-17T02:46:49.080144+0000","last_undegraded":"2024-08-17T02:46:49.080144+0000","last_fullsized":"2024-08-17T02:46:49.080144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:20.742107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.104896+0000","last_change":"2024-08-17T02:46:48.092015+0000","last_active":"2024-08-17T02:46:49.104896+0000","last_peered":"2024-08-17T02:46:49.104896+0000","last_clean":"2024-08-17T02:46:49.104896+0000","last_became_active":"2024-08-17T02:46:48.091717+0000","last_became_peered":"2024-08-17T02:46:48.091717+0000","last_unstale":"2024-08-17T02:46:49.104896+0000","last_undegraded":"2024-08-17T02:46:49.104896+0000","last_fullsized":"2024-08-17T02:46:49.104896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:40.545742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.094395+0000","last_change":"2024-08-17T02:46:49.089752+0000","last_active":"2024-08-17T02:46:49.094395+0000","last_peered":"2024-08-17T02:46:49.094395+0000","last_clean":"2024-08-17T02:46:49.094395+0000","last_became_active":"2024-08-17T02:46:49.089497+0000","last_became_peered":"2024-08-17T02:46:49.089497+0000","last_unstale":"2024-08-17T02:46:49.094395+0000","last_undegraded":"2024-08-17T02:46:49.094395+0000","last_fullsized":"2024-08-17T02:46:49.094395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:50.817438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.098272+0000","last_change":"2024-08-17T02:46:48.082388+0000","last_active":"2024-08-17T02:46:49.098272+0000","last_peered":"2024-08-17T02:46:49.098272+0000","last_clean":"2024-08-17T02:46:49.098272+0000","last_became_active":"2024-08-17T02:46:48.082137+0000","last_became_peered":"2024-08-17T02:46:48.082137+0000","last_unstale":"2024-08-17T02:46:49.098272+0000","last_undegraded":"2024-08-17T02:46:49.098272+0000","last_fullsized":"2024-08-17T02:46:49.098272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:09.795442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.100362+0000","last_change":"2024-08-17T02:46:49.091589+0000","last_active":"2024-08-17T02:46:49.100362+0000","last_peered":"2024-08-17T02:46:49.100362+0000","last_clean":"2024-08-17T02:46:49.100362+0000","last_became_active":"2024-08-17T02:46:49.091354+0000","last_became_peered":"2024-08-17T02:46:49.091354+0000","last_unstale":"2024-08-17T02:46:49.100362+0000","last_undegraded":"2024-08-17T02:46:49.100362+0000","last_fullsized":"2024-08-17T02:46:49.100362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:48.052641+0000","last_clean_scrub_stamp":"2024-08-17T02:46:48.052641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:34.672483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:49.103996+0000","last_change":"2024-08-17T02:46:48.081234+0000","last_active":"2024-08-17T02:46:49.103996+0000","last_peered":"2024-08-17T02:46:49.103996+0000","last_clean":"2024-08-17T02:46:49.103996+0000","last_became_active":"2024-08-17T02:46:48.081039+0000","last_became_peered":"2024-08-17T02:46:48.081039+0000","last_unstale":"2024-08-17T02:46:49.103996+0000","last_undegraded":"2024-08-17T02:46:49.103996+0000","last_fullsized":"2024-08-17T02:46:49.103996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.045423+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.045423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:23.635856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":819200,"data_stored":667426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.722}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.23}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":78040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":76578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":76614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6389999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3919999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":76488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":827392,"data_stored":667482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:58.625 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:46:58.625 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:46:58.625 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:46:58.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:46:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.807+0000 7f2af3200640 1 Processor -- start 2024-08-17T02:46:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.807+0000 7f2af3200640 1 -- start start 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec1567a0 0x7f2aec0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0ae7e0 con 0x7f2aec156b70 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af3200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0cc350 con 0x7f2aec0b09a0 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec156f60 con 0x7f2aec1567a0 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af1400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2aec156b70 0x7f2aec0b0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38040/0 (socket says 172.21.15.149:38040) 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af1400640 1 -- 172.21.15.149:0/3863897369 learned_addr learned my addr 172.21.15.149:0/3863897369 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:46:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.808+0000 7f2af1e00640 1 --2- 172.21.15.149:0/3863897369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec1567a0 0x7f2aec0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.809+0000 7f2af0a00640 1 -- 172.21.15.149:0/3863897369 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959982500 0 0) 0x7f2aec0ae7e0 con 0x7f2aec156b70 2024-08-17T02:46:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.809+0000 7f2af0a00640 1 -- 172.21.15.149:0/3863897369 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad40034e0 con 0x7f2aec156b70 2024-08-17T02:46:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.809+0000 7f2af1e00640 1 -- 172.21.15.149:0/3863897369 >> v1:172.21.15.161:6789/0 conn(0x7f2aec0b09a0 legacy=0x7f2aec0ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.809+0000 7f2af0a00640 1 -- 172.21.15.149:0/3863897369 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355382796 0 0) 0x7f2aec0cc350 con 0x7f2aec0b09a0 2024-08-17T02:46:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.809+0000 7f2af1e00640 1 -- 172.21.15.149:0/3863897369 >> v1:172.21.15.149:6789/0 conn(0x7f2aec156b70 legacy=0x7f2aec0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.809+0000 7f2af1e00640 1 -- 172.21.15.149:0/3863897369 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0b0e10 con 0x7f2aec1567a0 2024-08-17T02:46:58.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.810+0000 7f2af1e00640 1 --2- 172.21.15.149:0/3863897369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec1567a0 0x7f2aec0af510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009880 tx=0x7f2ae00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b539f0b108fee0b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.810+0000 7f2af0a00640 1 -- 172.21.15.149:0/3863897369 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae002ad80 con 0x7f2aec1567a0 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.810+0000 7f2af0a00640 1 -- 172.21.15.149:0/3863897369 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0032440 con 0x7f2aec1567a0 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.810+0000 7f2af0a00640 1 -- 172.21.15.149:0/3863897369 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00327e0 con 0x7f2aec1567a0 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 -- 172.21.15.149:0/3863897369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec1567a0 msgr2=0x7f2aec0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 --2- 172.21.15.149:0/3863897369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec1567a0 0x7f2aec0af510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009880 tx=0x7f2ae00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 -- 172.21.15.149:0/3863897369 shutdown_connections 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 --2- 172.21.15.149:0/3863897369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec1567a0 0x7f2aec0af510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 -- 172.21.15.149:0/3863897369 >> 172.21.15.149:0/3863897369 conn(0x7f2aec067750 msgr2=0x7f2aec0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 -- 172.21.15.149:0/3863897369 shutdown_connections 2024-08-17T02:46:58.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.811+0000 7f2af3200640 1 -- 172.21.15.149:0/3863897369 wait complete. 2024-08-17T02:46:58.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.812+0000 7f2af3200640 1 Processor -- start 2024-08-17T02:46:58.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.812+0000 7f2af3200640 1 -- start start 2024-08-17T02:46:58.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.813+0000 7f2af3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec0b09a0 0x7f2aec14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.813+0000 7f2af3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 0x7f2aec14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.813+0000 7f2af3200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aec156b70 0x7f2aec14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.813+0000 7f2af3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec14dc00 con 0x7f2aec1567a0 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.813+0000 7f2af3200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0ac8f0 con 0x7f2aec156b70 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.813+0000 7f2af3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0acbd0 con 0x7f2aec0b09a0 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 0x7f2aec14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 0x7f2aec14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44132/0 (socket says 172.21.15.149:44132) 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 -- 172.21.15.149:0/2453605171 learned_addr learned my addr 172.21.15.149:0/2453605171 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1e00640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec0b09a0 0x7f2aec14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af2800640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aec156b70 0x7f2aec14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 -- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec0b09a0 msgr2=0x7f2aec14e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec0b09a0 0x7f2aec14e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 -- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aec156b70 msgr2=0x7f2aec14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aec156b70 0x7f2aec14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 -- 172.21.15.149:0/2453605171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009390 con 0x7f2aec1567a0 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af1400640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 0x7f2aec14d180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c4b0 tx=0x7f2adc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc005aa0 con 0x7f2aec1567a0 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc005c00 con 0x7f2aec1567a0 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0070d0 con 0x7f2aec1567a0 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.814+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0aceb0 con 0x7f2aec1567a0 2024-08-17T02:46:58.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.815+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec14f1a0 con 0x7f2aec1567a0 2024-08-17T02:46:58.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.816+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec071050 con 0x7f2aec1567a0 2024-08-17T02:46:58.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.816+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2adc0074c0 con 0x7f2aec1567a0 2024-08-17T02:46:58.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.817+0000 7f2ae5600640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2ad0065150 0x7f2ad0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.817+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2adc0819a0 con 0x7f2aec1567a0 2024-08-17T02:46:58.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.817+0000 7f2af1e00640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2ad0065150 0x7f2ad0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.818+0000 7f2af1e00640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2ad0065150 0x7f2ad0067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0034000 tx=0x7f2ae0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:58.821+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2adc04f9c0 con 0x7f2aec1567a0 2024-08-17T02:46:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.028+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2aec0aa0f0 con 0x7f2aec1567a0 2024-08-17T02:46:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.029+0000 7f2ae5600640 1 -- 172.21.15.149:0/2453605171 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2adc017080 con 0x7f2aec1567a0 2024-08-17T02:46:59.030 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:59.030 INFO:teuthology.orchestra.run.smithi149.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:46:59.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2ad0065150 msgr2=0x7f2ad0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2ad0065150 0x7f2ad0067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0034000 tx=0x7f2ae0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:59.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 msgr2=0x7f2aec14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 0x7f2aec14d180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c4b0 tx=0x7f2adc007d60 comp rx=0 tx=0).stop 2024-08-17T02:46:59.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 shutdown_connections 2024-08-17T02:46:59.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2ad0065150 0x7f2ad0067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aec156b70 0x7f2aec14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aec1567a0 0x7f2aec14d180 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 --2- 172.21.15.149:0/2453605171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2aec0b09a0 0x7f2aec14e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 >> 172.21.15.149:0/2453605171 conn(0x7f2aec067750 msgr2=0x7f2aec154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 shutdown_connections 2024-08-17T02:46:59.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.031+0000 7f2af3200640 1 -- 172.21.15.149:0/2453605171 wait complete. 2024-08-17T02:46:59.047 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:46:59.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:59.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.198+0000 7f08e7200640 1 Processor -- start 2024-08-17T02:46:59.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.198+0000 7f08e7200640 1 -- start start 2024-08-17T02:46:59.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e7200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0158d60 0x7f08e00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e7200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f08e015cb30 0x7f08e00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e7200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08e0159130 0x7f08e00c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e7200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00b18d0 con 0x7f08e0159130 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e7200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00b0d00 con 0x7f08e015cb30 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e7200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00b0fa0 con 0x7f08e0158d60 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e5200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08e0159130 0x7f08e00c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e5200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08e0159130 0x7f08e00c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44134/0 (socket says 172.21.15.149:44134) 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08e5200640 1 -- 172.21.15.149:0/3840934748 learned_addr learned my addr 172.21.15.149:0/3840934748 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08d7400640 1 --2- 172.21.15.149:0/3840934748 >> v2:172.21.15.161:3300/0 conn(0x7f08e015cb30 0x7f08e00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.199+0000 7f08dfe00640 1 --2- 172.21.15.149:0/3840934748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0158d60 0x7f08e00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.200+0000 7f08e5200640 1 -- 172.21.15.149:0/3840934748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0158d60 msgr2=0x7f08e00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.200+0000 7f08e5200640 1 --2- 172.21.15.149:0/3840934748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0158d60 0x7f08e00b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.200+0000 7f08e5200640 1 -- 172.21.15.149:0/3840934748 >> v2:172.21.15.161:3300/0 conn(0x7f08e015cb30 msgr2=0x7f08e00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.200+0000 7f08e5200640 1 --2- 172.21.15.149:0/3840934748 >> v2:172.21.15.161:3300/0 conn(0x7f08e015cb30 0x7f08e00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.200+0000 7f08e5200640 1 -- 172.21.15.149:0/3840934748 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00b1280 con 0x7f08e0159130 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.201+0000 7f08e5200640 1 --2- 172.21.15.149:0/3840934748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e0159130 0x7f08e00c6d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b3bb0 tx=0x7f08d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc554c1d369e3977 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.201+0000 7f08df400640 1 -- 172.21.15.149:0/3840934748 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d802add0 con 0x7f08e0159130 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.201+0000 7f08df400640 1 -- 172.21.15.149:0/3840934748 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8032440 con 0x7f08e0159130 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.201+0000 7f08df400640 1 -- 172.21.15.149:0/3840934748 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8032820 con 0x7f08e0159130 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.201+0000 7f08e7200640 1 -- 172.21.15.149:0/3840934748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e0159130 msgr2=0x7f08e00c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.201+0000 7f08e7200640 1 --2- 172.21.15.149:0/3840934748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e0159130 0x7f08e00c6d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b3bb0 tx=0x7f08d80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 -- 172.21.15.149:0/3840934748 shutdown_connections 2024-08-17T02:46:59.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 --2- 172.21.15.149:0/3840934748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e0159130 0x7f08e00c6d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 --2- 172.21.15.149:0/3840934748 >> v2:172.21.15.161:3300/0 conn(0x7f08e015cb30 0x7f08e00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 --2- 172.21.15.149:0/3840934748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0158d60 0x7f08e00b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 -- 172.21.15.149:0/3840934748 >> 172.21.15.149:0/3840934748 conn(0x7f08e00b3040 msgr2=0x7f08e00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 -- 172.21.15.149:0/3840934748 shutdown_connections 2024-08-17T02:46:59.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.202+0000 7f08e7200640 1 -- 172.21.15.149:0/3840934748 wait complete. 2024-08-17T02:46:59.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.203+0000 7f08e7200640 1 Processor -- start 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.203+0000 7f08e7200640 1 -- start start 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e7200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e0158d60 0x7f08e0157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e7200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0159130 0x7f08e016a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 0x7f08e00ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c9d40 con 0x7f08e015cb30 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e7200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0169a20 con 0x7f08e0158d60 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e7200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0169d00 con 0x7f08e0159130 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 0x7f08e00ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 0x7f08e00ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44148/0 (socket says 172.21.15.149:44148) 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.204+0000 7f08e5200640 1 -- 172.21.15.149:0/2703696570 learned_addr learned my addr 172.21.15.149:0/2703696570 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:59.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08d7400640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0159130 0x7f08e016a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08dfe00640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e0158d60 0x7f08e0157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e5200640 1 -- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0159130 msgr2=0x7f08e016a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e5200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0159130 0x7f08e016a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e5200640 1 -- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e0158d60 msgr2=0x7f08e0157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e5200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e0158d60 0x7f08e0157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e5200640 1 -- 172.21.15.149:0/2703696570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009450 con 0x7f08e015cb30 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08d7400640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0159130 0x7f08e016a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08dfe00640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e0158d60 0x7f08e0157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e5200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 0x7f08e00ca790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f08d8035040 tx=0x7f08d8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8006b30 con 0x7f08e015cb30 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8031de0 con 0x7f08e015cb30 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d803d690 con 0x7f08e015cb30 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e00c9f90 con 0x7f08e015cb30 2024-08-17T02:46:59.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.205+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e0157e70 con 0x7f08e015cb30 2024-08-17T02:46:59.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.206+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e0064db0 con 0x7f08e015cb30 2024-08-17T02:46:59.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.207+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08d8039040 con 0x7f08e015cb30 2024-08-17T02:46:59.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.208+0000 7f08d7e00640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f08bc065150 0x7f08bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.208+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08d80a2410 con 0x7f08e015cb30 2024-08-17T02:46:59.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.208+0000 7f08dfe00640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f08bc065150 0x7f08bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.209+0000 7f08dfe00640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f08bc065150 0x7f08bc067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007780 tx=0x7f08d000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.212+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08d8070430 con 0x7f08e015cb30 2024-08-17T02:46:59.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.384+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e0069af0 con 0x7f08e015cb30 2024-08-17T02:46:59.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.385+0000 7f08d7e00640 1 -- 172.21.15.149:0/2703696570 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f08d8073a50 con 0x7f08e015cb30 2024-08-17T02:46:59.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:46:59.386 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:59.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.387+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f08bc065150 msgr2=0x7f08bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.387+0000 7f08e7200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f08bc065150 0x7f08bc067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007780 tx=0x7f08d000b040 comp rx=0 tx=0).stop 2024-08-17T02:46:59.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.387+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 msgr2=0x7f08e00ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.387+0000 7f08e7200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 0x7f08e00ca790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f08d8035040 tx=0x7f08d8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:59.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 shutdown_connections 2024-08-17T02:46:59.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f08bc065150 0x7f08bc067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08e015cb30 0x7f08e00ca790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e0159130 0x7f08e016a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 --2- 172.21.15.149:0/2703696570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e0158d60 0x7f08e0157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 >> 172.21.15.149:0/2703696570 conn(0x7f08e00b3040 msgr2=0x7f08e0096a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 shutdown_connections 2024-08-17T02:46:59.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.388+0000 7f08e7200640 1 -- 172.21.15.149:0/2703696570 wait complete. 2024-08-17T02:46:59.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:59.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:59.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.554+0000 7f82d7400640 1 Processor -- start 2024-08-17T02:46:59.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.554+0000 7f82d7400640 1 -- start start 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d7400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82d00accf0 0x7f82d00b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d7400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0159610 0x7f82d00af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d7400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82d00afbc0 0x7f82d0156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d7400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00b0040 con 0x7f82d00accf0 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d7400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00ae540 con 0x7f82d00afbc0 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d7400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00ad930 con 0x7f82d0159610 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82d00accf0 0x7f82d00b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82d00accf0 0x7f82d00b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44150/0 (socket says 172.21.15.149:44150) 2024-08-17T02:46:59.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 -- 172.21.15.149:0/2253010554 learned_addr learned my addr 172.21.15.149:0/2253010554 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82cfe00640 1 --2- 172.21.15.149:0/2253010554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0159610 0x7f82d00af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d5400640 1 --2- 172.21.15.149:0/2253010554 >> v2:172.21.15.161:3300/0 conn(0x7f82d00afbc0 0x7f82d0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 -- 172.21.15.149:0/2253010554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0159610 msgr2=0x7f82d00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 --2- 172.21.15.149:0/2253010554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0159610 0x7f82d00af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 -- 172.21.15.149:0/2253010554 >> v2:172.21.15.161:3300/0 conn(0x7f82d00afbc0 msgr2=0x7f82d0156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 --2- 172.21.15.149:0/2253010554 >> v2:172.21.15.161:3300/0 conn(0x7f82d00afbc0 0x7f82d0156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.556+0000 7f82d4a00640 1 -- 172.21.15.149:0/2253010554 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00adc10 con 0x7f82d00accf0 2024-08-17T02:46:59.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.557+0000 7f82d4a00640 1 --2- 172.21.15.149:0/2253010554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d00b1670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82d006c730 tx=0x7f82c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aa0b60b2fd56a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82cf400640 1 -- 172.21.15.149:0/2253010554 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c002ad40 con 0x7f82d00accf0 2024-08-17T02:46:59.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82cf400640 1 -- 172.21.15.149:0/2253010554 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0032440 con 0x7f82d00accf0 2024-08-17T02:46:59.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82cf400640 1 -- 172.21.15.149:0/2253010554 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c002aea0 con 0x7f82d00accf0 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 -- 172.21.15.149:0/2253010554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 msgr2=0x7f82d00b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 --2- 172.21.15.149:0/2253010554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d00b1670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82d006c730 tx=0x7f82c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 -- 172.21.15.149:0/2253010554 shutdown_connections 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 --2- 172.21.15.149:0/2253010554 >> v2:172.21.15.161:3300/0 conn(0x7f82d00afbc0 0x7f82d0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 --2- 172.21.15.149:0/2253010554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0159610 0x7f82d00af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 --2- 172.21.15.149:0/2253010554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d00b1670 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 -- 172.21.15.149:0/2253010554 >> 172.21.15.149:0/2253010554 conn(0x7f82d0067750 msgr2=0x7f82d00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 -- 172.21.15.149:0/2253010554 shutdown_connections 2024-08-17T02:46:59.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.558+0000 7f82d7400640 1 -- 172.21.15.149:0/2253010554 wait complete. 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.560+0000 7f82d7400640 1 Processor -- start 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.560+0000 7f82d7400640 1 -- start start 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d7400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d01546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d7400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d00afbc0 0x7f82d0131a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d7400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0159610 0x7f82d0149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d7400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d014c8e0 con 0x7f82d00accf0 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d7400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d014cbc0 con 0x7f82d0159610 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d7400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d014cea0 con 0x7f82d00afbc0 2024-08-17T02:46:59.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d01546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d01546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44166/0 (socket says 172.21.15.149:44166) 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 -- 172.21.15.149:0/2737489865 learned_addr learned my addr 172.21.15.149:0/2737489865 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82cfe00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d00afbc0 0x7f82d0131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d5400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0159610 0x7f82d0149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 -- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d00afbc0 msgr2=0x7f82d0131a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d00afbc0 0x7f82d0131a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 -- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0159610 msgr2=0x7f82d0149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0159610 0x7f82d0149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d4a00640 1 -- 172.21.15.149:0/2737489865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0009450 con 0x7f82d00accf0 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.561+0000 7f82d5400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0159610 0x7f82d0149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:59.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.562+0000 7f82d4a00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d01546e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009210 tx=0x7f82c0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.562+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031a60 con 0x7f82d00accf0 2024-08-17T02:46:59.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.562+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0031be0 con 0x7f82d00accf0 2024-08-17T02:46:59.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.562+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c003d420 con 0x7f82d00accf0 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.562+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d014d180 con 0x7f82d00accf0 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.562+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d014c520 con 0x7f82d00accf0 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.563+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d0064db0 con 0x7f82d00accf0 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.564+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f82c0039040 con 0x7f82d00accf0 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.565+0000 7f82c7e00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f82b0065150 0x7f82b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.565+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82c00a1fa0 con 0x7f82d00accf0 2024-08-17T02:46:59.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.565+0000 7f82cfe00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f82b0065150 0x7f82b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.566+0000 7f82cfe00640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f82b0065150 0x7f82b0067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f82d014c290 tx=0x7f82bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.569+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82c0070070 con 0x7f82d00accf0 2024-08-17T02:46:59.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.743+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82d00cc480 con 0x7f82d00accf0 2024-08-17T02:46:59.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.743+0000 7f82c7e00640 1 -- 172.21.15.149:0/2737489865 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82c0042020 con 0x7f82d00accf0 2024-08-17T02:46:59.744 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:46:59.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.745+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f82b0065150 msgr2=0x7f82b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.745+0000 7f82d7400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f82b0065150 0x7f82b0067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f82d014c290 tx=0x7f82bc008040 comp rx=0 tx=0).stop 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 msgr2=0x7f82d01546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d01546e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009210 tx=0x7f82c0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 shutdown_connections 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f82b0065150 0x7f82b0067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0159610 0x7f82d0149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d00afbc0 0x7f82d0131a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.751 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 --2- 172.21.15.149:0/2737489865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d00accf0 0x7f82d01546e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.751 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 >> 172.21.15.149:0/2737489865 conn(0x7f82d0067750 msgr2=0x7f82d00cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.751 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 shutdown_connections 2024-08-17T02:46:59.751 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.746+0000 7f82d7400640 1 -- 172.21.15.149:0/2737489865 wait complete. 2024-08-17T02:46:59.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:59.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.913+0000 7fc4a1200640 1 Processor -- start 2024-08-17T02:46:59.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.913+0000 7fc4a1200640 1 -- start start 2024-08-17T02:46:59.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc4a1200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc49c158e20 0x7fc49c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc4a1200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc49c0c3390 0x7fc49c0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc4a1200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c088f20 0x7fc49c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc4a1200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0cb540 con 0x7fc49c158e20 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc4a1200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0cf7f0 con 0x7fc49c0c3390 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc4a1200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0caef0 con 0x7fc49c088f20 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc499e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc49c158e20 0x7fc49c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc499e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc49c158e20 0x7fc49c0ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44174/0 (socket says 172.21.15.149:44174) 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc499e00640 1 -- 172.21.15.149:0/1923388588 learned_addr learned my addr 172.21.15.149:0/1923388588 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc499400640 1 --2- 172.21.15.149:0/1923388588 >> v2:172.21.15.161:3300/0 conn(0x7fc49c0c3390 0x7fc49c0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.914+0000 7fc49a800640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c088f20 0x7fc49c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.915+0000 7fc499e00640 1 -- 172.21.15.149:0/1923388588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c088f20 msgr2=0x7fc49c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.915+0000 7fc499e00640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c088f20 0x7fc49c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.915+0000 7fc499e00640 1 -- 172.21.15.149:0/1923388588 >> v2:172.21.15.161:3300/0 conn(0x7fc49c0c3390 msgr2=0x7fc49c0ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.915+0000 7fc499e00640 1 --2- 172.21.15.149:0/1923388588 >> v2:172.21.15.161:3300/0 conn(0x7fc49c0c3390 0x7fc49c0ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.915+0000 7fc499e00640 1 -- 172.21.15.149:0/1923388588 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0cb1d0 con 0x7fc49c158e20 2024-08-17T02:46:59.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.915+0000 7fc49a800640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c088f20 0x7fc49c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:59.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.916+0000 7fc499e00640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c0ca310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc49c15cb70 tx=0x7fc48c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ffd9ae205b5799 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.916+0000 7fc498a00640 1 -- 172.21.15.149:0/1923388588 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c02add0 con 0x7fc49c158e20 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.916+0000 7fc498a00640 1 -- 172.21.15.149:0/1923388588 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c032440 con 0x7fc49c158e20 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.916+0000 7fc498a00640 1 -- 172.21.15.149:0/1923388588 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c032820 con 0x7fc49c158e20 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.916+0000 7fc4a1200640 1 -- 172.21.15.149:0/1923388588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 msgr2=0x7fc49c0ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.916+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c0ca310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc49c15cb70 tx=0x7fc48c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 -- 172.21.15.149:0/1923388588 shutdown_connections 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c088f20 0x7fc49c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1923388588 >> v2:172.21.15.161:3300/0 conn(0x7fc49c0c3390 0x7fc49c0ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1923388588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c0ca310 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 -- 172.21.15.149:0/1923388588 >> 172.21.15.149:0/1923388588 conn(0x7fc49c0cfd70 msgr2=0x7fc49c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 -- 172.21.15.149:0/1923388588 shutdown_connections 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.917+0000 7fc4a1200640 1 -- 172.21.15.149:0/1923388588 wait complete. 2024-08-17T02:46:59.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.918+0000 7fc4a1200640 1 Processor -- start 2024-08-17T02:46:59.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.918+0000 7fc4a1200640 1 -- start start 2024-08-17T02:46:59.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc4a1200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c088f20 0x7fc49c169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc4a1200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c3390 0x7fc49c16bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc4a1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c09a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc4a1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0c3a30 con 0x7fc49c158e20 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc4a1200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0c42d0 con 0x7fc49c088f20 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc4a1200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c09b040 con 0x7fc49c0c3390 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc49a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c09a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc49a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c09a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44190/0 (socket says 172.21.15.149:44190) 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.919+0000 7fc49a800640 1 -- 172.21.15.149:0/1020428518 learned_addr learned my addr 172.21.15.149:0/1020428518 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc499400640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c3390 0x7fc49c16bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc499e00640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c088f20 0x7fc49c169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc49a800640 1 -- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c3390 msgr2=0x7fc49c16bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc49a800640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c3390 0x7fc49c16bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc49a800640 1 -- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c088f20 msgr2=0x7fc49c169f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc49a800640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c088f20 0x7fc49c169f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc49a800640 1 -- 172.21.15.149:0/1020428518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c009450 con 0x7fc49c158e20 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc499e00640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c088f20 0x7fc49c169f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc49a800640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c09a7c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc49400d100 tx=0x7fc4940099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49400dee0 con 0x7fc49c158e20 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400f040 con 0x7fc49c158e20 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c0c3c80 con 0x7fc49c158e20 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494015650 con 0x7fc49c158e20 2024-08-17T02:46:59.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.920+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c16c0b0 con 0x7fc49c158e20 2024-08-17T02:46:59.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.922+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0c4460 con 0x7fc49c158e20 2024-08-17T02:46:59.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.922+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc494015a00 con 0x7fc49c158e20 2024-08-17T02:46:59.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.923+0000 7fc491600640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc47c065150 0x7fc47c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.923+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc494082cc0 con 0x7fc49c158e20 2024-08-17T02:46:59.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.923+0000 7fc499e00640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc47c065150 0x7fc47c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.924+0000 7fc499e00640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc47c065150 0x7fc47c067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc48c034000 tx=0x7fc48c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:46:59.927+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc494089080 con 0x7fc49c158e20 2024-08-17T02:47:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.101+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc49c071050 con 0x7fc49c158e20 2024-08-17T02:47:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.101+0000 7fc491600640 1 -- 172.21.15.149:0/1020428518 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc494050ce0 con 0x7fc49c158e20 2024-08-17T02:47:00.102 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.103+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc47c065150 msgr2=0x7fc47c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.103+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc47c065150 0x7fc47c067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc48c034000 tx=0x7fc48c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.103+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 msgr2=0x7fc49c09a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.103+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c09a7c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc49400d100 tx=0x7fc4940099f0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.103+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 shutdown_connections 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc47c065150 0x7fc47c067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc49c158e20 0x7fc49c09a7c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c3390 0x7fc49c16bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 --2- 172.21.15.149:0/1020428518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c088f20 0x7fc49c169f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 >> 172.21.15.149:0/1020428518 conn(0x7fc49c0cfd70 msgr2=0x7fc49c0c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 shutdown_connections 2024-08-17T02:47:00.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.104+0000 7fc4a1200640 1 -- 172.21.15.149:0/1020428518 wait complete. 2024-08-17T02:47:00.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:00.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.269+0000 7fd6eb200640 1 Processor -- start 2024-08-17T02:47:00.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.269+0000 7fd6eb200640 1 -- start start 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6eb200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6ec0ce250 0x7fd6ec0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6eb200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6ec0cb980 0x7fd6ec158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6eb200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec0c5a40 con 0x7fd6ec0c4950 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6eb200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0c4e30 con 0x7fd6ec0ce250 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6eb200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0c5110 con 0x7fd6ec0cb980 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6ec0ce250 0x7fd6ec0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6ec0ce250 0x7fd6ec0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44194/0 (socket says 172.21.15.149:44194) 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 -- 172.21.15.149:0/1063507479 learned_addr learned my addr 172.21.15.149:0/1063507479 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9400640 1 --1- 172.21.15.149:0/1063507479 >> v1:172.21.15.149:6789/0 conn(0x7fd6ec0c4950 0x7fd6ec0b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38046/0 (socket says 172.21.15.149:38046) 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6ea800640 1 --2- 172.21.15.149:0/1063507479 >> v2:172.21.15.161:3300/0 conn(0x7fd6ec0cb980 0x7fd6ec158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 -- 172.21.15.149:0/1063507479 >> v2:172.21.15.161:3300/0 conn(0x7fd6ec0cb980 msgr2=0x7fd6ec158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 --2- 172.21.15.149:0/1063507479 >> v2:172.21.15.161:3300/0 conn(0x7fd6ec0cb980 0x7fd6ec158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 -- 172.21.15.149:0/1063507479 >> v1:172.21.15.149:6789/0 conn(0x7fd6ec0c4950 legacy=0x7fd6ec0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e9e00640 1 -- 172.21.15.149:0/1063507479 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0c53f0 con 0x7fd6ec0ce250 2024-08-17T02:47:00.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.271+0000 7fd6e8a00640 1 -- 172.21.15.149:0/1063507479 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420650504 0 0) 0x7fd6ec0c5a40 con 0x7fd6ec0c4950 2024-08-17T02:47:00.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.272+0000 7fd6e9e00640 1 --2- 172.21.15.149:0/1063507479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ce620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0cf740 tx=0x7fd6dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fff4622e0d2ba1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6e8a00640 1 -- 172.21.15.149:0/1063507479 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc02ae80 con 0x7fd6ec0ce250 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6e8a00640 1 -- 172.21.15.149:0/1063507479 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc032440 con 0x7fd6ec0ce250 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6e8a00640 1 -- 172.21.15.149:0/1063507479 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0327c0 con 0x7fd6ec0ce250 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 -- 172.21.15.149:0/1063507479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0ce250 msgr2=0x7fd6ec0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 --2- 172.21.15.149:0/1063507479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ce620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0cf740 tx=0x7fd6dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 -- 172.21.15.149:0/1063507479 shutdown_connections 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 --2- 172.21.15.149:0/1063507479 >> v2:172.21.15.161:3300/0 conn(0x7fd6ec0cb980 0x7fd6ec158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 --2- 172.21.15.149:0/1063507479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ce620 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 -- 172.21.15.149:0/1063507479 >> 172.21.15.149:0/1063507479 conn(0x7fd6ec098e30 msgr2=0x7fd6ec06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 -- 172.21.15.149:0/1063507479 shutdown_connections 2024-08-17T02:47:00.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.273+0000 7fd6eb200640 1 -- 172.21.15.149:0/1063507479 wait complete. 2024-08-17T02:47:00.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.275+0000 7fd6eb200640 1 Processor -- start 2024-08-17T02:47:00.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.275+0000 7fd6eb200640 1 -- start start 2024-08-17T02:47:00.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6eb200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6ec0c4950 0x7fd6ec1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6eb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 0x7fd6ec0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6eb200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6eb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec168e00 con 0x7fd6ec0cb980 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6eb200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1690e0 con 0x7fd6ec0ce250 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6eb200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1693c0 con 0x7fd6ec0c4950 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 0x7fd6ec0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 0x7fd6ec0c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44206/0 (socket says 172.21.15.149:44206) 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 -- 172.21.15.149:0/3754119306 learned_addr learned my addr 172.21.15.149:0/3754119306 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9e00640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6ec0c4950 0x7fd6ec1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6ea800640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 -- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6ec0c4950 msgr2=0x7fd6ec1444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6ec0c4950 0x7fd6ec1444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 -- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6ec0ce250 msgr2=0x7fd6ec0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6e9400640 1 -- 172.21.15.149:0/3754119306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009450 con 0x7fd6ec0cb980 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.276+0000 7fd6ea800640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.277+0000 7fd6e9400640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 0x7fd6ec0c8d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c5d0 tx=0x7fd6d8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.277+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80073d0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.277+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8007550 con 0x7fd6ec0cb980 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.277+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80049f0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.277+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec1696a0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.277+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec168ab0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.278+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec169ba0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.279+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6d80113a0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.280+0000 7fd6e1600640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6cc065150 0x7fd6cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.281+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6d80815b0 con 0x7fd6ec0cb980 2024-08-17T02:47:00.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.281+0000 7fd6e9e00640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6cc065150 0x7fd6cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.281+0000 7fd6e9e00640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6cc065150 0x7fd6cc067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc034000 tx=0x7fd6dc032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.284+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd6d804f700 con 0x7fd6ec0cb980 2024-08-17T02:47:00.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.456+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6ec071050 con 0x7fd6ec0cb980 2024-08-17T02:47:00.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.456+0000 7fd6e1600640 1 -- 172.21.15.149:0/3754119306 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6d8018020 con 0x7fd6ec0cb980 2024-08-17T02:47:00.457 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:00.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6cc065150 msgr2=0x7fd6cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6cc065150 0x7fd6cc067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc034000 tx=0x7fd6dc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:00.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 msgr2=0x7fd6ec0c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 0x7fd6ec0c8d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c5d0 tx=0x7fd6d8007d80 comp rx=0 tx=0).stop 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 shutdown_connections 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6cc065150 0x7fd6cc067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6ec0ce250 0x7fd6ec0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6ec0cb980 0x7fd6ec0c8d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 --2- 172.21.15.149:0/3754119306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6ec0c4950 0x7fd6ec1444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.458+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 >> 172.21.15.149:0/3754119306 conn(0x7fd6ec098e30 msgr2=0x7fd6ec068250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.459+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 shutdown_connections 2024-08-17T02:47:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.459+0000 7fd6eb200640 1 -- 172.21.15.149:0/3754119306 wait complete. 2024-08-17T02:47:00.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:00.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.624+0000 7f3be7e00640 1 Processor -- start 2024-08-17T02:47:00.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.624+0000 7f3be7e00640 1 -- start start 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.625+0000 7f3be7e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3be8158ad0 0x7f3be80ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.625+0000 7f3be7e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be8067d60 con 0x7f3be80ac5b0 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.625+0000 7f3be7e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be8068600 con 0x7f3be8158ea0 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.625+0000 7f3be7e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80aca30 con 0x7f3be8158ad0 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.625+0000 7f3be7400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3be80ac5b0 0x7f3be8068a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38060/0 (socket says 172.21.15.149:38060) 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.625+0000 7f3be7400640 1 -- 172.21.15.149:0/14738785 learned_addr learned my addr 172.21.15.149:0/14738785 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:00.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.626+0000 7f3be6a00640 1 --2- 172.21.15.149:0/14738785 >> v2:172.21.15.161:3300/0 conn(0x7f3be8158ad0 0x7f3be80ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.626+0000 7f3be6000640 1 -- 172.21.15.149:0/14738785 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766812868 0 0) 0x7f3be8067d60 con 0x7f3be80ac5b0 2024-08-17T02:47:00.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.626+0000 7f3be6000640 1 -- 172.21.15.149:0/14738785 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bcc0034e0 con 0x7f3be80ac5b0 2024-08-17T02:47:00.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.626+0000 7f3be6a00640 1 -- 172.21.15.149:0/14738785 >> v1:172.21.15.161:6789/0 conn(0x7f3be8158ea0 legacy=0x7f3be80af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.626+0000 7f3be6a00640 1 -- 172.21.15.149:0/14738785 >> v1:172.21.15.149:6789/0 conn(0x7f3be80ac5b0 legacy=0x7f3be8068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.626+0000 7f3be6a00640 1 -- 172.21.15.149:0/14738785 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80b01d0 con 0x7f3be8158ad0 2024-08-17T02:47:00.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.627+0000 7f3be6a00640 1 --2- 172.21.15.149:0/14738785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be80ac070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009850 tx=0x7f3bd80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a809d68a9ba39d17 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.628+0000 7f3be6000640 1 -- 172.21.15.149:0/14738785 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd802ad00 con 0x7f3be8158ad0 2024-08-17T02:47:00.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.628+0000 7f3be6000640 1 -- 172.21.15.149:0/14738785 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd802ae60 con 0x7f3be8158ad0 2024-08-17T02:47:00.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.628+0000 7f3be6000640 1 -- 172.21.15.149:0/14738785 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8032670 con 0x7f3be8158ad0 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 -- 172.21.15.149:0/14738785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 msgr2=0x7f3be80ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 --2- 172.21.15.149:0/14738785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be80ac070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009850 tx=0x7f3bd80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 -- 172.21.15.149:0/14738785 shutdown_connections 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 --2- 172.21.15.149:0/14738785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be80ac070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 -- 172.21.15.149:0/14738785 >> 172.21.15.149:0/14738785 conn(0x7f3be8096a70 msgr2=0x7f3be8096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 -- 172.21.15.149:0/14738785 shutdown_connections 2024-08-17T02:47:00.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.629+0000 7f3be7e00640 1 -- 172.21.15.149:0/14738785 wait complete. 2024-08-17T02:47:00.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.630+0000 7f3be7e00640 1 Processor -- start 2024-08-17T02:47:00.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.630+0000 7f3be7e00640 1 -- start start 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 0x7f3be80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be8145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be8158ea0 0x7f3be806a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b0d10 con 0x7f3be80ac5b0 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b26d0 con 0x7f3be8158ad0 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b29b0 con 0x7f3be8158ea0 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 0x7f3be80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 0x7f3be80b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44208/0 (socket says 172.21.15.149:44208) 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be6a00640 1 -- 172.21.15.149:0/3507019045 learned_addr learned my addr 172.21.15.149:0/3507019045 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:00.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3bde000640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be8145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.631+0000 7f3be7400640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be8158ea0 0x7f3be806a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be6a00640 1 -- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be8158ea0 msgr2=0x7f3be806a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be6a00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be8158ea0 0x7f3be806a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be6a00640 1 -- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 msgr2=0x7f3be8145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be6a00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be8145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be6a00640 1 -- 172.21.15.149:0/3507019045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8009390 con 0x7f3be80ac5b0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be7400640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be8158ea0 0x7f3be806a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be6a00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 0x7f3be80b31b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009360 tx=0x7f3bd8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd803b6e0 con 0x7f3be80ac5b0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd803b840 con 0x7f3be80ac5b0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd803bc00 con 0x7f3be80ac5b0 2024-08-17T02:47:00.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.632+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be80b2c90 con 0x7f3be80ac5b0 2024-08-17T02:47:00.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.633+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be8152830 con 0x7f3be80ac5b0 2024-08-17T02:47:00.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.633+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be80b2540 con 0x7f3be80ac5b0 2024-08-17T02:47:00.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.634+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3bd8043030 con 0x7f3be80ac5b0 2024-08-17T02:47:00.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.635+0000 7f3bdea00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3bc4065180 0x7f3bc4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.635+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3bd8041070 con 0x7f3be80ac5b0 2024-08-17T02:47:00.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.635+0000 7f3bde000640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3bc4065180 0x7f3bc4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.636+0000 7f3bde000640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3bc4065180 0x7f3bc4067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3be8153f30 tx=0x7f3bd0007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.639+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3bd8070da0 con 0x7f3be80ac5b0 2024-08-17T02:47:00.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.846+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3be8071050 con 0x7f3be80ac5b0 2024-08-17T02:47:00.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.846+0000 7f3bdea00640 1 -- 172.21.15.149:0/3507019045 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f3bd804b090 con 0x7f3be80ac5b0 2024-08-17T02:47:00.847 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:00.847 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:00.847 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:00.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.848+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3bc4065180 msgr2=0x7f3bc4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.848+0000 7f3be7e00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3bc4065180 0x7f3bc4067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3be8153f30 tx=0x7f3bd0007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:00.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.848+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 msgr2=0x7f3be80b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.848+0000 7f3be7e00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 0x7f3be80b31b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009360 tx=0x7f3bd8032000 comp rx=0 tx=0).stop 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 shutdown_connections 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3bc4065180 0x7f3bc4067630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be8158ea0 0x7f3be806a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be8158ad0 0x7f3be8145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 --2- 172.21.15.149:0/3507019045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be80ac5b0 0x7f3be80b31b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 >> 172.21.15.149:0/3507019045 conn(0x7f3be8096a70 msgr2=0x7f3be815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 shutdown_connections 2024-08-17T02:47:00.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:00.849+0000 7f3be7e00640 1 -- 172.21.15.149:0/3507019045 wait complete. 2024-08-17T02:47:00.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:01.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.013+0000 7f55b6000640 1 Processor -- start 2024-08-17T02:47:01.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.013+0000 7f55b6000640 1 -- start start 2024-08-17T02:47:01.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.014+0000 7f55b6000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55b0155df0 0x7f55b00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.014+0000 7f55b6000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b0156670 con 0x7f55b006df00 2024-08-17T02:47:01.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.014+0000 7f55b6000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b006e5e0 con 0x7f55b0155a20 2024-08-17T02:47:01.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.014+0000 7f55b6000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00b0350 con 0x7f55b0155df0 2024-08-17T02:47:01.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55aea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f55b006df00 0x7f55b0156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38072/0 (socket says 172.21.15.149:38072) 2024-08-17T02:47:01.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55aea00640 1 -- 172.21.15.149:0/3646733187 learned_addr learned my addr 172.21.15.149:0/3646733187 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:01.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55afe00640 1 --2- 172.21.15.149:0/3646733187 >> v2:172.21.15.161:3300/0 conn(0x7f55b0155df0 0x7f55b00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55ae000640 1 -- 172.21.15.149:0/3646733187 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780138844 0 0) 0x7f55b0156670 con 0x7f55b006df00 2024-08-17T02:47:01.016 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55ae000640 1 -- 172.21.15.149:0/3646733187 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55940034e0 con 0x7f55b006df00 2024-08-17T02:47:01.017 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55afe00640 1 -- 172.21.15.149:0/3646733187 >> v1:172.21.15.161:6789/0 conn(0x7f55b0155a20 legacy=0x7f55b006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.017 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55afe00640 1 -- 172.21.15.149:0/3646733187 >> v1:172.21.15.149:6789/0 conn(0x7f55b006df00 legacy=0x7f55b0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.017 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.015+0000 7f55afe00640 1 -- 172.21.15.149:0/3646733187 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b006e8c0 con 0x7f55b0155df0 2024-08-17T02:47:01.017 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.016+0000 7f55afe00640 1 --2- 172.21.15.149:0/3646733187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155df0 0x7f55b00adf10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009e60 tx=0x7f55a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac884e741f8ec7b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.016+0000 7f55ae000640 1 -- 172.21.15.149:0/3646733187 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8007550 con 0x7f55b0155df0 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.016+0000 7f55ae000640 1 -- 172.21.15.149:0/3646733187 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a802d050 con 0x7f55b0155df0 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.016+0000 7f55ae000640 1 -- 172.21.15.149:0/3646733187 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80078e0 con 0x7f55b0155df0 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 -- 172.21.15.149:0/3646733187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155df0 msgr2=0x7f55b00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 --2- 172.21.15.149:0/3646733187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155df0 0x7f55b00adf10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009e60 tx=0x7f55a8009780 comp rx=0 tx=0).stop 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 -- 172.21.15.149:0/3646733187 shutdown_connections 2024-08-17T02:47:01.018 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 --2- 172.21.15.149:0/3646733187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155df0 0x7f55b00adf10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 -- 172.21.15.149:0/3646733187 >> 172.21.15.149:0/3646733187 conn(0x7f55b00cb9b0 msgr2=0x7f55b00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 -- 172.21.15.149:0/3646733187 shutdown_connections 2024-08-17T02:47:01.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.017+0000 7f55b6000640 1 -- 172.21.15.149:0/3646733187 wait complete. 2024-08-17T02:47:01.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.018+0000 7f55b6000640 1 Processor -- start 2024-08-17T02:47:01.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 -- start start 2024-08-17T02:47:01.021 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55b006df00 0x7f55b01402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155a20 0x7f55b0165e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 0x7f55b00ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00ab930 con 0x7f55b0155df0 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00abc10 con 0x7f55b0155a20 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.019+0000 7f55b6000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00abef0 con 0x7f55b006df00 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 0x7f55b00ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 0x7f55b00ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44224/0 (socket says 172.21.15.149:44224) 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 -- 172.21.15.149:0/762630713 learned_addr learned my addr 172.21.15.149:0/762630713 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55aea00640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155a20 0x7f55b0165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55af400640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55b006df00 0x7f55b01402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 -- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55b006df00 msgr2=0x7f55b01402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55b006df00 0x7f55b01402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 -- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155a20 msgr2=0x7f55b0165e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155a20 0x7f55b0165e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 -- 172.21.15.149:0/762630713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8009a20 con 0x7f55b0155df0 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55aea00640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155a20 0x7f55b0165e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.020+0000 7f55afe00640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 0x7f55b00ac9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55a80099f0 tx=0x7f55a8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.021+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8031aa0 con 0x7f55b0155df0 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.021+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8031c00 con 0x7f55b0155df0 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.021+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b00ac1d0 con 0x7f55b0155df0 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.021+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8045460 con 0x7f55b0155df0 2024-08-17T02:47:01.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.021+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b00ab5e0 con 0x7f55b0155df0 2024-08-17T02:47:01.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.022+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b00ac6d0 con 0x7f55b0155df0 2024-08-17T02:47:01.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.023+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f55a803c420 con 0x7f55b0155df0 2024-08-17T02:47:01.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.023+0000 7f55a6a00640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5590065150 0x7f5590067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.023+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55a80a4070 con 0x7f55b0155df0 2024-08-17T02:47:01.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.024+0000 7f55af400640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5590065150 0x7f5590067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.024+0000 7f55af400640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5590065150 0x7f5590067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ad660 tx=0x7f55a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.027+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f55a8072150 con 0x7f55b0155df0 2024-08-17T02:47:01.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.209+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55b0064db0 con 0x7f55b0155df0 2024-08-17T02:47:01.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.210+0000 7f55a6a00640 1 -- 172.21.15.149:0/762630713 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f55a8075770 con 0x7f55b0155df0 2024-08-17T02:47:01.210 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:01.210 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:01.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5590065150 msgr2=0x7f5590067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5590065150 0x7f5590067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ad660 tx=0x7f55a0009040 comp rx=0 tx=0).stop 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 msgr2=0x7f55b00ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 0x7f55b00ac9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55a80099f0 tx=0x7f55a8037000 comp rx=0 tx=0).stop 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 shutdown_connections 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5590065150 0x7f5590067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55b0155df0 0x7f55b00ac9d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55b0155a20 0x7f55b0165e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 --2- 172.21.15.149:0/762630713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55b006df00 0x7f55b01402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 >> 172.21.15.149:0/762630713 conn(0x7f55b00cb9b0 msgr2=0x7f55b0154800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 shutdown_connections 2024-08-17T02:47:01.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.212+0000 7f55b6000640 1 -- 172.21.15.149:0/762630713 wait complete. 2024-08-17T02:47:01.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:01.228 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.379+0000 7fa3b8400640 1 Processor -- start 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.379+0000 7fa3b8400640 1 -- start start 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b8400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3b0158f60 0x7fa3b00ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b8400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b00cc5f0 0x7fa3b00acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b8400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00ac390 con 0x7fa3b0158b90 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b8400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00ab4a0 con 0x7fa3b0158f60 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b8400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00ab780 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b5000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3b0158f60 0x7fa3b00ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b5000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3b0158f60 0x7fa3b00ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44236/0 (socket says 172.21.15.149:44236) 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b5000640 1 -- 172.21.15.149:0/381228871 learned_addr learned my addr 172.21.15.149:0/381228871 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.380+0000 7fa3b6400640 1 --2- 172.21.15.149:0/381228871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b00cc5f0 0x7fa3b00acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.381+0000 7fa3b5000640 1 -- 172.21.15.149:0/381228871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b00cc5f0 msgr2=0x7fa3b00acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.381+0000 7fa3b5000640 1 --2- 172.21.15.149:0/381228871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b00cc5f0 0x7fa3b00acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.381+0000 7fa3b5000640 1 -- 172.21.15.149:0/381228871 >> v1:172.21.15.161:6789/0 conn(0x7fa3b0158b90 legacy=0x7fa3b00aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.381+0000 7fa3b5000640 1 -- 172.21.15.149:0/381228871 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00aba60 con 0x7fa3b0158f60 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.382+0000 7fa3b5000640 1 --2- 172.21.15.149:0/381228871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0158f60 0x7fa3b00ac820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009910 tx=0x7fa39c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e816ad1fb128e9ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.382+0000 7fa3afe00640 1 -- 172.21.15.149:0/381228871 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c02adb0 con 0x7fa3b0158f60 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.382+0000 7fa3afe00640 1 -- 172.21.15.149:0/381228871 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c032440 con 0x7fa3b0158f60 2024-08-17T02:47:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.382+0000 7fa3afe00640 1 -- 172.21.15.149:0/381228871 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c032820 con 0x7fa3b0158f60 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.382+0000 7fa3b8400640 1 -- 172.21.15.149:0/381228871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0158f60 msgr2=0x7fa3b00ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.382+0000 7fa3b8400640 1 --2- 172.21.15.149:0/381228871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0158f60 0x7fa3b00ac820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009910 tx=0x7fa39c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.383+0000 7fa3b8400640 1 -- 172.21.15.149:0/381228871 shutdown_connections 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.383+0000 7fa3b8400640 1 --2- 172.21.15.149:0/381228871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b00cc5f0 0x7fa3b00acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.383+0000 7fa3b8400640 1 --2- 172.21.15.149:0/381228871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0158f60 0x7fa3b00ac820 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.383+0000 7fa3b8400640 1 -- 172.21.15.149:0/381228871 >> 172.21.15.149:0/381228871 conn(0x7fa3b0067750 msgr2=0x7fa3b00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.383+0000 7fa3b8400640 1 -- 172.21.15.149:0/381228871 shutdown_connections 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.383+0000 7fa3b8400640 1 -- 172.21.15.149:0/381228871 wait complete. 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.384+0000 7fa3b8400640 1 Processor -- start 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.384+0000 7fa3b8400640 1 -- start start 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 0x7fa3b0152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b8400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0158b90 0x7fa3b0152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b8400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b0158f60 0x7fa3b0155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00cad80 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b8400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0152db0 con 0x7fa3b0158b90 2024-08-17T02:47:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b8400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01581f0 con 0x7fa3b0158f60 2024-08-17T02:47:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 0x7fa3b0152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 0x7fa3b0152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44246/0 (socket says 172.21.15.149:44246) 2024-08-17T02:47:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.385+0000 7fa3b5a00640 1 -- 172.21.15.149:0/266238908 learned_addr learned my addr 172.21.15.149:0/266238908 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5000640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0158b90 0x7fa3b0152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b6400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b0158f60 0x7fa3b0155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5a00640 1 -- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b0158f60 msgr2=0x7fa3b0155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5a00640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b0158f60 0x7fa3b0155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5a00640 1 -- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0158b90 msgr2=0x7fa3b0152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5a00640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0158b90 0x7fa3b0152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5a00640 1 -- 172.21.15.149:0/266238908 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009450 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5000640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0158b90 0x7fa3b0152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b6400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b0158f60 0x7fa3b0155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b5a00640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 0x7fa3b0152fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c560 tx=0x7fa3a4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011590 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4011710 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b01549a0 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011ad0 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.386+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0154690 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.387+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0064db0 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.388+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa3a401b3b0 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.389+0000 7fa3acc00640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa390065180 0x7fa390067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.389+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3a4081a30 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.389+0000 7fa3b5000640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa390065180 0x7fa390067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.390+0000 7fa3b5000640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa390065180 0x7fa390067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa39c034000 tx=0x7fa39c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.393+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa3a404fa50 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.563+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3b015a480 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.563+0000 7fa3acc00640 1 -- 172.21.15.149:0/266238908 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3a4017070 con 0x7fa3b00cc5f0 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:01.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.565+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa390065180 msgr2=0x7fa390067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.565+0000 7fa3b8400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa390065180 0x7fa390067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa39c034000 tx=0x7fa39c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.565+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 msgr2=0x7fa3b0152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.565+0000 7fa3b8400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 0x7fa3b0152fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c560 tx=0x7fa3a4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 shutdown_connections 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa390065180 0x7fa390067630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3b0158f60 0x7fa3b0155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0158b90 0x7fa3b0152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 --2- 172.21.15.149:0/266238908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b00cc5f0 0x7fa3b0152fd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 >> 172.21.15.149:0/266238908 conn(0x7fa3b0067750 msgr2=0x7fa3b0159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 shutdown_connections 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.566+0000 7fa3b8400640 1 -- 172.21.15.149:0/266238908 wait complete. 2024-08-17T02:47:01.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:01.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.732+0000 7f3c42600640 1 Processor -- start 2024-08-17T02:47:01.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.733+0000 7f3c42600640 1 -- start start 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c42600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c3c066cd0 0x7f3c3c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c42600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c3c15c760 0x7f3c3c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c42600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c15d0c0 con 0x7f3c3c0cb9f0 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c42600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c1536c0 con 0x7f3c3c066cd0 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c42600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c06d720 con 0x7f3c3c15c760 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c41200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3c3c0cb9f0 0x7f3c3c0abde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38082/0 (socket says 172.21.15.149:38082) 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c41200640 1 -- 172.21.15.149:0/3157414717 learned_addr learned my addr 172.21.15.149:0/3157414717 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:01.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.734+0000 7f3c33e00640 1 --2- 172.21.15.149:0/3157414717 >> v2:172.21.15.149:3300/0 conn(0x7f3c3c066cd0 0x7f3c3c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c41c00640 1 --2- 172.21.15.149:0/3157414717 >> v2:172.21.15.161:3300/0 conn(0x7f3c3c15c760 0x7f3c3c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c3be00640 1 -- 172.21.15.149:0/3157414717 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219836715 0 0) 0x7f3c3c15d0c0 con 0x7f3c3c0cb9f0 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c3be00640 1 -- 172.21.15.149:0/3157414717 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c200034e0 con 0x7f3c3c0cb9f0 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c33e00640 1 -- 172.21.15.149:0/3157414717 >> v2:172.21.15.161:3300/0 conn(0x7f3c3c15c760 msgr2=0x7f3c3c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c33e00640 1 --2- 172.21.15.149:0/3157414717 >> v2:172.21.15.161:3300/0 conn(0x7f3c3c15c760 0x7f3c3c15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c33e00640 1 -- 172.21.15.149:0/3157414717 >> v1:172.21.15.149:6789/0 conn(0x7f3c3c0cb9f0 legacy=0x7f3c3c0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c33e00640 1 -- 172.21.15.149:0/3157414717 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c06da00 con 0x7f3c3c066cd0 2024-08-17T02:47:01.737 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.735+0000 7f3c41c00640 1 --2- 172.21.15.149:0/3157414717 >> v2:172.21.15.161:3300/0 conn(0x7f3c3c15c760 0x7f3c3c15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:01.737 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.736+0000 7f3c33e00640 1 --2- 172.21.15.149:0/3157414717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c06d020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c06cda0 tx=0x7f3c240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d92253c354dcd82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.736+0000 7f3c3be00640 1 -- 172.21.15.149:0/3157414717 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2402ad20 con 0x7f3c3c066cd0 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.736+0000 7f3c3be00640 1 -- 172.21.15.149:0/3157414717 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2402ae80 con 0x7f3c3c066cd0 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.736+0000 7f3c3be00640 1 -- 172.21.15.149:0/3157414717 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24032670 con 0x7f3c3c066cd0 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 -- 172.21.15.149:0/3157414717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c066cd0 msgr2=0x7f3c3c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 --2- 172.21.15.149:0/3157414717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c06d020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c06cda0 tx=0x7f3c240090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 -- 172.21.15.149:0/3157414717 shutdown_connections 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 --2- 172.21.15.149:0/3157414717 >> v2:172.21.15.161:3300/0 conn(0x7f3c3c15c760 0x7f3c3c15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 --2- 172.21.15.149:0/3157414717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c06d020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 -- 172.21.15.149:0/3157414717 >> 172.21.15.149:0/3157414717 conn(0x7f3c3c0cca90 msgr2=0x7f3c3c0a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 -- 172.21.15.149:0/3157414717 shutdown_connections 2024-08-17T02:47:01.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.737+0000 7f3c42600640 1 -- 172.21.15.149:0/3157414717 wait complete. 2024-08-17T02:47:01.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.738+0000 7f3c42600640 1 Processor -- start 2024-08-17T02:47:01.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.738+0000 7f3c42600640 1 -- start start 2024-08-17T02:47:01.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c42600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c42600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c3c0cb9f0 0x7f3c3c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c42600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 0x7f3c3c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c42600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c159600 con 0x7f3c3c15c760 2024-08-17T02:47:01.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c42600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c1598e0 con 0x7f3c3c066cd0 2024-08-17T02:47:01.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c42600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c159bc0 con 0x7f3c3c0cb9f0 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c41c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 0x7f3c3c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c41c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 0x7f3c3c157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44264/0 (socket says 172.21.15.149:44264) 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c41c00640 1 -- 172.21.15.149:0/2690555214 learned_addr learned my addr 172.21.15.149:0/2690555214 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c33e00640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c3c0cb9f0 0x7f3c3c156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.739+0000 7f3c41200640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41c00640 1 -- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c3c0cb9f0 msgr2=0x7f3c3c156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41c00640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c3c0cb9f0 0x7f3c3c156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41c00640 1 -- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c3c066cd0 msgr2=0x7f3c3c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41c00640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41c00640 1 -- 172.21.15.149:0/2690555214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009390 con 0x7f3c3c15c760 2024-08-17T02:47:01.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41200640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:01.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c41c00640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 0x7f3c3c157290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400a380 tx=0x7f3c34007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400d650 con 0x7f3c3c15c760 2024-08-17T02:47:01.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3400d7b0 con 0x7f3c3c15c760 2024-08-17T02:47:01.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c159ea0 con 0x7f3c3c15c760 2024-08-17T02:47:01.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400db70 con 0x7f3c3c15c760 2024-08-17T02:47:01.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.740+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c159160 con 0x7f3c3c15c760 2024-08-17T02:47:01.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.741+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c1593b0 con 0x7f3c3c15c760 2024-08-17T02:47:01.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.742+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c3401e3b0 con 0x7f3c3c15c760 2024-08-17T02:47:01.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.743+0000 7f3c38c00640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3c18065150 0x7f3c18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.743+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c34082e50 con 0x7f3c3c15c760 2024-08-17T02:47:01.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.743+0000 7f3c41200640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3c18065150 0x7f3c18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.744+0000 7f3c41200640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3c18065150 0x7f3c18067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c005840 tx=0x7f3c2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.747+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3c34050f20 con 0x7f3c3c15c760 2024-08-17T02:47:01.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.919+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c3c0b0160 con 0x7f3c3c15c760 2024-08-17T02:47:01.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.919+0000 7f3c38c00640 1 -- 172.21.15.149:0/2690555214 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c3401a0a0 con 0x7f3c3c15c760 2024-08-17T02:47:01.920 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:01.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3c18065150 msgr2=0x7f3c18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3c18065150 0x7f3c18067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c005840 tx=0x7f3c2c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 msgr2=0x7f3c3c157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 0x7f3c3c157290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400a380 tx=0x7f3c34007900 comp rx=0 tx=0).stop 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 shutdown_connections 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3c18065150 0x7f3c18067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c3c15c760 0x7f3c3c157290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c3c0cb9f0 0x7f3c3c156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 --2- 172.21.15.149:0/2690555214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c3c066cd0 0x7f3c3c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.921+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 >> 172.21.15.149:0/2690555214 conn(0x7f3c3c0cca90 msgr2=0x7f3c3c15b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.922+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 shutdown_connections 2024-08-17T02:47:01.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:01.922+0000 7f3c42600640 1 -- 172.21.15.149:0/2690555214 wait complete. 2024-08-17T02:47:01.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:02.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.087+0000 7fcc62000640 1 Processor -- start 2024-08-17T02:47:02.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.087+0000 7fcc62000640 1 -- start start 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc62000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcc5c0ad3e0 0x7fcc5c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc62000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 0x7fcc5c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc62000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c156e60 con 0x7fcc5c0abef0 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc62000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c95e0 con 0x7fcc5c0ad3e0 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc62000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0ac2c0 con 0x7fcc5c06d930 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc60c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcc5c0abef0 0x7fcc5c0accd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38088/0 (socket says 172.21.15.149:38088) 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc60c00640 1 -- 172.21.15.149:0/2386207608 learned_addr learned my addr 172.21.15.149:0/2386207608 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:02.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc5be00640 1 --2- 172.21.15.149:0/2386207608 >> v2:172.21.15.161:3300/0 conn(0x7fcc5c0ad3e0 0x7fcc5c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc61600640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 0x7fcc5c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406748295 0 0) 0x7fcc5c156e60 con 0x7fcc5c0abef0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.089+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc440034e0 con 0x7fcc5c0abef0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057363079 0 0) 0x7fcc440034e0 con 0x7fcc5c0abef0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 msgr2=0x7fcc5c0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 0x7fcc5c0c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 >> v2:172.21.15.161:3300/0 conn(0x7fcc5c0ad3e0 msgr2=0x7fcc5c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 --2- 172.21.15.149:0/2386207608 >> v2:172.21.15.161:3300/0 conn(0x7fcc5c0ad3e0 0x7fcc5c06d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c06e100 con 0x7fcc5c0abef0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7fcc50001470 con 0x7fcc5c0abef0 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 --2- 172.21.15.149:0/2386207608 >> v2:172.21.15.161:3300/0 conn(0x7fcc5c0ad3e0 0x7fcc5c06d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:02.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 >> v1:172.21.15.149:6789/0 conn(0x7fcc5c0abef0 legacy=0x7fcc5c0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 0x7fcc44003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc44004020 0x7fcc44004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc44004cc0 0x7fcc44005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c95e0 con 0x7fcc44004020 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0ac2c0 con 0x7fcc44004cc0 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4400bad0 con 0x7fcc5c06d930 2024-08-17T02:47:02.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc44004020 0x7fcc44004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc61600640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc44004cc0 0x7fcc44005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc60c00640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 0x7fcc44003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 -- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 msgr2=0x7fcc44003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc5c06d930 0x7fcc44003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 -- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc44004cc0 msgr2=0x7fcc44005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc44004cc0 0x7fcc44005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.090+0000 7fcc5be00640 1 -- 172.21.15.149:0/2386207608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440034e0 con 0x7fcc44004020 2024-08-17T02:47:02.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.091+0000 7fcc5be00640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc44004020 0x7fcc44004780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc48006e70 tx=0x7fcc480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2e533499fafa8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48031400 con 0x7fcc44004020 2024-08-17T02:47:02.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4802d050 con 0x7fcc44004020 2024-08-17T02:47:02.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc5b400640 1 -- 172.21.15.149:0/2386207608 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48031770 con 0x7fcc44004020 2024-08-17T02:47:02.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc62000640 1 -- 172.21.15.149:0/2386207608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc44004020 msgr2=0x7fcc44004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc62000640 1 --2- 172.21.15.149:0/2386207608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc44004020 0x7fcc44004780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc48006e70 tx=0x7fcc480090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc61600640 1 -- 172.21.15.149:0/2386207608 reap_dead start 2024-08-17T02:47:02.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc62000640 1 -- 172.21.15.149:0/2386207608 shutdown_connections 2024-08-17T02:47:02.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc62000640 1 -- 172.21.15.149:0/2386207608 >> 172.21.15.149:0/2386207608 conn(0x7fcc5c066cd0 msgr2=0x7fcc5c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc62000640 1 -- 172.21.15.149:0/2386207608 shutdown_connections 2024-08-17T02:47:02.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.092+0000 7fcc62000640 1 -- 172.21.15.149:0/2386207608 wait complete. 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.094+0000 7fcc62000640 1 Processor -- start 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.094+0000 7fcc62000640 1 -- start start 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc62000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc44004020 0x7fcc5c169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc62000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 0x7fcc5c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc62000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc5c152eb0 0x7fcc5c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc62000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c4200 con 0x7fcc5c0c3850 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc62000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c153be0 con 0x7fcc5c152eb0 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc62000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c153ec0 con 0x7fcc44004020 2024-08-17T02:47:02.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 0x7fcc5c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 0x7fcc5c0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44282/0 (socket says 172.21.15.149:44282) 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 -- 172.21.15.149:0/1956414141 learned_addr learned my addr 172.21.15.149:0/1956414141 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc60c00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc44004020 0x7fcc5c169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc61600640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc5c152eb0 0x7fcc5c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 -- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc44004020 msgr2=0x7fcc5c169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc44004020 0x7fcc5c169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 -- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc5c152eb0 msgr2=0x7fcc5c153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc5c152eb0 0x7fcc5c153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.095+0000 7fcc5be00640 1 -- 172.21.15.149:0/1956414141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c1541a0 con 0x7fcc5c0c3850 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.096+0000 7fcc5be00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 0x7fcc5c0c3cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc4802acb0 tx=0x7fcc48035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.096+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4803c700 con 0x7fcc5c0c3850 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.096+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4803c860 con 0x7fcc5c0c3850 2024-08-17T02:47:02.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.096+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4803cc00 con 0x7fcc5c0c3850 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.096+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c154480 con 0x7fcc5c0c3850 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.096+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c153850 con 0x7fcc5c0c3850 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.097+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c071050 con 0x7fcc5c0c3850 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.098+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcc4803b3b0 con 0x7fcc5c0c3850 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.099+0000 7fcc4fe00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcc3c065150 0x7fcc3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.099+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc480a3800 con 0x7fcc5c0c3850 2024-08-17T02:47:02.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.099+0000 7fcc60c00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcc3c065150 0x7fcc3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.100+0000 7fcc60c00640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcc3c065150 0x7fcc3c067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc50001c50 tx=0x7fcc50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.103+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcc480718e0 con 0x7fcc5c0c3850 2024-08-17T02:47:02.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.278+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc5c0ad950 con 0x7fcc5c0c3850 2024-08-17T02:47:02.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.278+0000 7fcc4fe00640 1 -- 172.21.15.149:0/1956414141 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc4804a020 con 0x7fcc5c0c3850 2024-08-17T02:47:02.279 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:02.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcc3c065150 msgr2=0x7fcc3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcc3c065150 0x7fcc3c067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc50001c50 tx=0x7fcc50009040 comp rx=0 tx=0).stop 2024-08-17T02:47:02.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 msgr2=0x7fcc5c0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 0x7fcc5c0c3cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc4802acb0 tx=0x7fcc48035000 comp rx=0 tx=0).stop 2024-08-17T02:47:02.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 shutdown_connections 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcc3c065150 0x7fcc3c067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc5c152eb0 0x7fcc5c153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5c0c3850 0x7fcc5c0c3cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 --2- 172.21.15.149:0/1956414141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc44004020 0x7fcc5c169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 >> 172.21.15.149:0/1956414141 conn(0x7fcc5c066cd0 msgr2=0x7fcc5c0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 shutdown_connections 2024-08-17T02:47:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.280+0000 7fcc62000640 1 -- 172.21.15.149:0/1956414141 wait complete. 2024-08-17T02:47:02.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:02.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.444+0000 7f0166000640 1 Processor -- start 2024-08-17T02:47:02.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.444+0000 7f0166000640 1 -- start start 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.445+0000 7f0166000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01600b1440 0x7f01600caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.445+0000 7f0166000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f01600c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.445+0000 7f0166000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01600caa80 con 0x7f01601401b0 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.445+0000 7f0166000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600cb450 con 0x7f01600b1440 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.445+0000 7f0166000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600c9e70 con 0x7f0160140580 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01600b1440 0x7f01600caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01600b1440 0x7f01600caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44298/0 (socket says 172.21.15.149:44298) 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 -- 172.21.15.149:0/2366361133 learned_addr learned my addr 172.21.15.149:0/2366361133 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015fe00640 1 --2- 172.21.15.149:0/2366361133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f01600c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 -- 172.21.15.149:0/2366361133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 msgr2=0x7f01600c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 --2- 172.21.15.149:0/2366361133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f01600c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 -- 172.21.15.149:0/2366361133 >> v1:172.21.15.161:6789/0 conn(0x7f01601401b0 legacy=0x7f01600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.446+0000 7f015ea00640 1 -- 172.21.15.149:0/2366361133 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600ca150 con 0x7f01600b1440 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.447+0000 7f015ea00640 1 --2- 172.21.15.149:0/2366361133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01600b1440 0x7f01600caf10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f014c009910 tx=0x7f014c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6862edabcc392964 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.447+0000 7f015e000640 1 -- 172.21.15.149:0/2366361133 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c02ae40 con 0x7f01600b1440 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.447+0000 7f015e000640 1 -- 172.21.15.149:0/2366361133 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c032440 con 0x7f01600b1440 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f015e000640 1 -- 172.21.15.149:0/2366361133 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c032820 con 0x7f01600b1440 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 -- 172.21.15.149:0/2366361133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01600b1440 msgr2=0x7f01600caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 --2- 172.21.15.149:0/2366361133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01600b1440 0x7f01600caf10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f014c009910 tx=0x7f014c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 -- 172.21.15.149:0/2366361133 shutdown_connections 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 --2- 172.21.15.149:0/2366361133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f01600c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 --2- 172.21.15.149:0/2366361133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01600b1440 0x7f01600caf10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 -- 172.21.15.149:0/2366361133 >> 172.21.15.149:0/2366361133 conn(0x7f01600cb9b0 msgr2=0x7f01600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 -- 172.21.15.149:0/2366361133 shutdown_connections 2024-08-17T02:47:02.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.448+0000 7f0166000640 1 -- 172.21.15.149:0/2366361133 wait complete. 2024-08-17T02:47:02.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.449+0000 7f0166000640 1 Processor -- start 2024-08-17T02:47:02.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 -- start start 2024-08-17T02:47:02.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01600b1440 0x7f0160156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 0x7f01601599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f0160159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600ab770 con 0x7f01601401b0 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600aba50 con 0x7f01600b1440 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.450+0000 7f0166000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600abd30 con 0x7f0160140580 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 0x7f01601599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 0x7f01601599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44310/0 (socket says 172.21.15.149:44310) 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 -- 172.21.15.149:0/754491164 learned_addr learned my addr 172.21.15.149:0/754491164 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015f400640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01600b1440 0x7f0160156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015fe00640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f0160159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 -- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 msgr2=0x7f0160159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f0160159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 -- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01600b1440 msgr2=0x7f0160156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01600b1440 0x7f0160156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 -- 172.21.15.149:0/754491164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c009450 con 0x7f01601401b0 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015fe00640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f0160159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:02.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.451+0000 7f015ea00640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 0x7f01601599d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f014c035040 tx=0x7f014c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.452+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c031bb0 con 0x7f01601401b0 2024-08-17T02:47:02.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.452+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c031d30 con 0x7f01601401b0 2024-08-17T02:47:02.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.452+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01600ac010 con 0x7f01601401b0 2024-08-17T02:47:02.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.452+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c031ea0 con 0x7f01601401b0 2024-08-17T02:47:02.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.452+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0160156b60 con 0x7f01601401b0 2024-08-17T02:47:02.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.453+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0160064db0 con 0x7f01601401b0 2024-08-17T02:47:02.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.454+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f014c039040 con 0x7f01601401b0 2024-08-17T02:47:02.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.454+0000 7f0156a00640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0140065150 0x7f0140067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.454+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f014c02ae40 con 0x7f01601401b0 2024-08-17T02:47:02.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.455+0000 7f015f400640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0140065150 0x7f0140067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.455+0000 7f015f400640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0140065150 0x7f0140067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0160132de0 tx=0x7f0150009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.458+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f014c070610 con 0x7f01601401b0 2024-08-17T02:47:02.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.670+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0160156b60 con 0x7f01601401b0 2024-08-17T02:47:02.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.671+0000 7f0156a00640 1 -- 172.21.15.149:0/754491164 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f0160156b60 con 0x7f01601401b0 2024-08-17T02:47:02.672 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:02.672 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:02.673 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:02.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0140065150 msgr2=0x7f0140067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0140065150 0x7f0140067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0160132de0 tx=0x7f0150009040 comp rx=0 tx=0).stop 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 msgr2=0x7f01601599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 0x7f01601599d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f014c035040 tx=0x7f014c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 shutdown_connections 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0140065150 0x7f0140067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0160140580 0x7f0160159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01601401b0 0x7f01601599d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 --2- 172.21.15.149:0/754491164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01600b1440 0x7f0160156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.673+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 >> 172.21.15.149:0/754491164 conn(0x7f01600cb9b0 msgr2=0x7f01600aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.674+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 shutdown_connections 2024-08-17T02:47:02.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.674+0000 7f0166000640 1 -- 172.21.15.149:0/754491164 wait complete. 2024-08-17T02:47:02.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:02.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.839+0000 7fca43e00640 1 Processor -- start 2024-08-17T02:47:02.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.839+0000 7fca43e00640 1 -- start start 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.840+0000 7fca43e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c0aa7d0 0x7fca3c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.840+0000 7fca43e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca3c158fa0 0x7fca3c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.840+0000 7fca43e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c0a9a10 con 0x7fca3c06da20 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.840+0000 7fca43e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c0ac400 con 0x7fca3c158fa0 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.840+0000 7fca43e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0a9cf0 con 0x7fca3c0aa7d0 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca41400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fca3c06da20 0x7fca3c158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38090/0 (socket says 172.21.15.149:38090) 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca41400640 1 -- 172.21.15.149:0/3193845654 learned_addr learned my addr 172.21.15.149:0/3193845654 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca40a00640 1 --2- 172.21.15.149:0/3193845654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c0aa7d0 0x7fca3c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca41e00640 1 --2- 172.21.15.149:0/3193845654 >> v2:172.21.15.161:3300/0 conn(0x7fca3c158fa0 0x7fca3c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca3be00640 1 -- 172.21.15.149:0/3193845654 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651422050 0 0) 0x7fca3c0a9a10 con 0x7fca3c06da20 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca3be00640 1 -- 172.21.15.149:0/3193845654 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca240034e0 con 0x7fca3c06da20 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca40a00640 1 -- 172.21.15.149:0/3193845654 >> v2:172.21.15.161:3300/0 conn(0x7fca3c158fa0 msgr2=0x7fca3c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca40a00640 1 --2- 172.21.15.149:0/3193845654 >> v2:172.21.15.161:3300/0 conn(0x7fca3c158fa0 0x7fca3c0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca40a00640 1 -- 172.21.15.149:0/3193845654 >> v1:172.21.15.149:6789/0 conn(0x7fca3c06da20 legacy=0x7fca3c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca40a00640 1 -- 172.21.15.149:0/3193845654 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c0a9fd0 con 0x7fca3c0aa7d0 2024-08-17T02:47:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.841+0000 7fca41e00640 1 --2- 172.21.15.149:0/3193845654 >> v2:172.21.15.161:3300/0 conn(0x7fca3c158fa0 0x7fca3c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca40a00640 1 --2- 172.21.15.149:0/3193845654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c0aa7d0 0x7fca3c06ddf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca28009850 tx=0x7fca280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15940472fb107a07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca3be00640 1 -- 172.21.15.149:0/3193845654 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2802ad00 con 0x7fca3c0aa7d0 2024-08-17T02:47:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca3be00640 1 -- 172.21.15.149:0/3193845654 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2802ae60 con 0x7fca3c0aa7d0 2024-08-17T02:47:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca3be00640 1 -- 172.21.15.149:0/3193845654 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28032670 con 0x7fca3c0aa7d0 2024-08-17T02:47:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 -- 172.21.15.149:0/3193845654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c0aa7d0 msgr2=0x7fca3c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 --2- 172.21.15.149:0/3193845654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c0aa7d0 0x7fca3c06ddf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca28009850 tx=0x7fca280090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 -- 172.21.15.149:0/3193845654 shutdown_connections 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 --2- 172.21.15.149:0/3193845654 >> v2:172.21.15.161:3300/0 conn(0x7fca3c158fa0 0x7fca3c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 --2- 172.21.15.149:0/3193845654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c0aa7d0 0x7fca3c06ddf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 -- 172.21.15.149:0/3193845654 >> 172.21.15.149:0/3193845654 conn(0x7fca3c0cb9b0 msgr2=0x7fca3c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.843+0000 7fca43e00640 1 -- 172.21.15.149:0/3193845654 shutdown_connections 2024-08-17T02:47:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.844+0000 7fca43e00640 1 -- 172.21.15.149:0/3193845654 wait complete. 2024-08-17T02:47:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.845+0000 7fca43e00640 1 Processor -- start 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.845+0000 7fca43e00640 1 -- start start 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca43e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c06da20 0x7fca3c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca43e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0aa7d0 0x7fca3c159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca43e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 0x7fca3c159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca43e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c16a480 con 0x7fca3c158fa0 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca43e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c1529a0 con 0x7fca3c0aa7d0 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca43e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c154be0 con 0x7fca3c06da20 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 0x7fca3c159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 0x7fca3c159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44320/0 (socket says 172.21.15.149:44320) 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41e00640 1 -- 172.21.15.149:0/258166339 learned_addr learned my addr 172.21.15.149:0/258166339 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca40a00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0aa7d0 0x7fca3c159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41400640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c06da20 0x7fca3c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41e00640 1 -- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c06da20 msgr2=0x7fca3c140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c06da20 0x7fca3c140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.846+0000 7fca41e00640 1 -- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0aa7d0 msgr2=0x7fca3c159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca41e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0aa7d0 0x7fca3c159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca41e00640 1 -- 172.21.15.149:0/258166339 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca34009a20 con 0x7fca3c158fa0 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca41400640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c06da20 0x7fca3c140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca41e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 0x7fca3c159960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca34009f20 tx=0x7fca3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ce10 con 0x7fca3c158fa0 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400f040 con 0x7fca3c158fa0 2024-08-17T02:47:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340146d0 con 0x7fca3c158fa0 2024-08-17T02:47:02.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca28009390 con 0x7fca3c158fa0 2024-08-17T02:47:02.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.847+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c1551a0 con 0x7fca3c158fa0 2024-08-17T02:47:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.848+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c16a5f0 con 0x7fca3c158fa0 2024-08-17T02:47:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.849+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fca34003020 con 0x7fca3c158fa0 2024-08-17T02:47:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.850+0000 7fca38c00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fca1c065150 0x7fca1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.850+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca34082fc0 con 0x7fca3c158fa0 2024-08-17T02:47:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.850+0000 7fca41400640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fca1c065150 0x7fca1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.851+0000 7fca41400640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fca1c065150 0x7fca1c067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca30005840 tx=0x7fca30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:02.854+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fca3c16a5f0 con 0x7fca3c158fa0 2024-08-17T02:47:03.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.026+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca3c16a5c0 con 0x7fca3c158fa0 2024-08-17T02:47:03.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.027+0000 7fca38c00640 1 -- 172.21.15.149:0/258166339 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fca34050fe0 con 0x7fca3c158fa0 2024-08-17T02:47:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:03.028 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fca1c065150 msgr2=0x7fca1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fca1c065150 0x7fca1c067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca30005840 tx=0x7fca30009040 comp rx=0 tx=0).stop 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 msgr2=0x7fca3c159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 0x7fca3c159960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca34009f20 tx=0x7fca3400b040 comp rx=0 tx=0).stop 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 shutdown_connections 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fca1c065150 0x7fca1c067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca3c158fa0 0x7fca3c159960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0aa7d0 0x7fca3c159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 --2- 172.21.15.149:0/258166339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca3c06da20 0x7fca3c140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 >> 172.21.15.149:0/258166339 conn(0x7fca3c0cb9b0 msgr2=0x7fca3c06ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 shutdown_connections 2024-08-17T02:47:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.029+0000 7fca43e00640 1 -- 172.21.15.149:0/258166339 wait complete. 2024-08-17T02:47:03.047 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:03.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.196+0000 7fe9d9000640 1 Processor -- start 2024-08-17T02:47:03.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.196+0000 7fe9d9000640 1 -- start start 2024-08-17T02:47:03.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.197+0000 7fe9d9000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe9d4155a20 0x7fe9d40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.197+0000 7fe9d9000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9d4155df0 0x7fe9d40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.197+0000 7fe9d9000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d4156670 con 0x7fe9d406d7f0 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.197+0000 7fe9d9000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40b0350 con 0x7fe9d4155df0 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.197+0000 7fe9d9000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d406e5e0 con 0x7fe9d4155a20 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.197+0000 7fe9d1400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9d4155df0 0x7fe9d40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9d4155df0 0x7fe9d40ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44332/0 (socket says 172.21.15.149:44332) 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d2800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe9d406d7f0 0x7fe9d40ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38094/0 (socket says 172.21.15.149:38094) 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1400640 1 -- 172.21.15.149:0/3771231395 learned_addr learned my addr 172.21.15.149:0/3771231395 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1e00640 1 --2- 172.21.15.149:0/3771231395 >> v2:172.21.15.161:3300/0 conn(0x7fe9d4155a20 0x7fe9d40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1400640 1 -- 172.21.15.149:0/3771231395 >> v2:172.21.15.161:3300/0 conn(0x7fe9d4155a20 msgr2=0x7fe9d40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1400640 1 --2- 172.21.15.149:0/3771231395 >> v2:172.21.15.161:3300/0 conn(0x7fe9d4155a20 0x7fe9d40adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1400640 1 -- 172.21.15.149:0/3771231395 >> v1:172.21.15.149:6789/0 conn(0x7fe9d406d7f0 legacy=0x7fe9d40ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d1400640 1 -- 172.21.15.149:0/3771231395 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d406e8c0 con 0x7fe9d4155df0 2024-08-17T02:47:03.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.198+0000 7fe9d0a00640 1 -- 172.21.15.149:0/3771231395 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712391599 0 0) 0x7fe9d4156670 con 0x7fe9d406d7f0 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.199+0000 7fe9d1400640 1 --2- 172.21.15.149:0/3771231395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ad9b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe9d406bc00 tx=0x7fe9c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777348ab05844533 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.199+0000 7fe9d0a00640 1 -- 172.21.15.149:0/3771231395 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c002ae80 con 0x7fe9d4155df0 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.199+0000 7fe9d0a00640 1 -- 172.21.15.149:0/3771231395 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0032440 con 0x7fe9d4155df0 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.199+0000 7fe9d0a00640 1 -- 172.21.15.149:0/3771231395 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00327c0 con 0x7fe9d4155df0 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 -- 172.21.15.149:0/3771231395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155df0 msgr2=0x7fe9d40ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 --2- 172.21.15.149:0/3771231395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ad9b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe9d406bc00 tx=0x7fe9c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 -- 172.21.15.149:0/3771231395 shutdown_connections 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 --2- 172.21.15.149:0/3771231395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ad9b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 --2- 172.21.15.149:0/3771231395 >> v2:172.21.15.161:3300/0 conn(0x7fe9d4155a20 0x7fe9d40adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 -- 172.21.15.149:0/3771231395 >> 172.21.15.149:0/3771231395 conn(0x7fe9d40cb9b0 msgr2=0x7fe9d40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 -- 172.21.15.149:0/3771231395 shutdown_connections 2024-08-17T02:47:03.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.200+0000 7fe9d9000640 1 -- 172.21.15.149:0/3771231395 wait complete. 2024-08-17T02:47:03.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.201+0000 7fe9d9000640 1 Processor -- start 2024-08-17T02:47:03.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.201+0000 7fe9d9000640 1 -- start start 2024-08-17T02:47:03.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.202+0000 7fe9d9000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9d406d7f0 0x7fe9d4152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.202+0000 7fe9d9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 0x7fe9d40a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.202+0000 7fe9d9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.202+0000 7fe9d9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40ac5f0 con 0x7fe9d4155a20 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.202+0000 7fe9d9000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40a7290 con 0x7fe9d4155df0 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.202+0000 7fe9d9000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40a7570 con 0x7fe9d406d7f0 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 0x7fe9d40a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 0x7fe9d40a9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44348/0 (socket says 172.21.15.149:44348) 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 -- 172.21.15.149:0/2054969595 learned_addr learned my addr 172.21.15.149:0/2054969595 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d2800640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 -- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9d406d7f0 msgr2=0x7fe9d4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1e00640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9d406d7f0 0x7fe9d4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9d406d7f0 0x7fe9d4152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 -- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9d4155df0 msgr2=0x7fe9d40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 -- 172.21.15.149:0/2054969595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009450 con 0x7fe9d4155a20 2024-08-17T02:47:03.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1e00640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9d406d7f0 0x7fe9d4152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:03.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d2800640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:03.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9d1400640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 0x7fe9d40a9240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009210 tx=0x7fe9c0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.203+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0031de0 con 0x7fe9d4155a20 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.204+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c003d420 con 0x7fe9d4155a20 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.204+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d40a7850 con 0x7fe9d4155a20 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.204+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c003d7e0 con 0x7fe9d4155a20 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.204+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d40a7e10 con 0x7fe9d4155a20 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.205+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d4168c90 con 0x7fe9d4155a20 2024-08-17T02:47:03.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.205+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe9c0039040 con 0x7fe9d4155a20 2024-08-17T02:47:03.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.206+0000 7fe9c9600640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe9b4065150 0x7fe9b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.206+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9c00a2c20 con 0x7fe9d4155a20 2024-08-17T02:47:03.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.206+0000 7fe9d1e00640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe9b4065150 0x7fe9b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.207+0000 7fe9d1e00640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe9b4065150 0x7fe9b4067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40099b0 tx=0x7fe9c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.211+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe9d4168c90 con 0x7fe9d4155a20 2024-08-17T02:47:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.416+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9d4168c90 con 0x7fe9d4155a20 2024-08-17T02:47:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.417+0000 7fe9c9600640 1 -- 172.21.15.149:0/2054969595 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fe9d4168c90 con 0x7fe9d4155a20 2024-08-17T02:47:03.417 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:03.418 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:03.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe9b4065150 msgr2=0x7fe9b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe9b4065150 0x7fe9b4067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40099b0 tx=0x7fe9c4008040 comp rx=0 tx=0).stop 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 msgr2=0x7fe9d40a9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 0x7fe9d40a9240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009210 tx=0x7fe9c0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 shutdown_connections 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe9b4065150 0x7fe9b4067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9d4155df0 0x7fe9d40ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9d4155a20 0x7fe9d40a9240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 --2- 172.21.15.149:0/2054969595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9d406d7f0 0x7fe9d4152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 >> 172.21.15.149:0/2054969595 conn(0x7fe9d40cb9b0 msgr2=0x7fe9d4154950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 shutdown_connections 2024-08-17T02:47:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.419+0000 7fe9d9000640 1 -- 172.21.15.149:0/2054969595 wait complete. 2024-08-17T02:47:03.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:46:48.469804+0000', 'modified': '2024-08-17T02:46:52.087128+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6835/4028834101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 4028834101}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 4028834101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:47:03.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:47:03.838 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:47:03.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.988+0000 7fc9f4e00640 1 Processor -- start 2024-08-17T02:47:03.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.989+0000 7fc9f4e00640 1 -- start start 2024-08-17T02:47:03.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.990+0000 7fc9f4e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc9f0155900 0x7fc9f0155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.990+0000 7fc9f4e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 0x7fc9f00ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.990+0000 7fc9f4e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f0157690 con 0x7fc9f00b0270 2024-08-17T02:47:03.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.990+0000 7fc9f4e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f0156a80 con 0x7fc9f0155900 2024-08-17T02:47:03.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.990+0000 7fc9f4e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0156d60 con 0x7fc9f0158b30 2024-08-17T02:47:03.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 0x7fc9f00ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9ef400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc9f0155900 0x7fc9f0155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 0x7fc9f00ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52640/0 (socket says 172.21.15.149:52640) 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 -- 172.21.15.149:0/1207061251 learned_addr learned my addr 172.21.15.149:0/1207061251 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 -- 172.21.15.149:0/1207061251 >> v2:172.21.15.161:3300/0 conn(0x7fc9f0155900 msgr2=0x7fc9f0155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 --2- 172.21.15.149:0/1207061251 >> v2:172.21.15.161:3300/0 conn(0x7fc9f0155900 0x7fc9f0155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 -- 172.21.15.149:0/1207061251 >> v1:172.21.15.161:6789/0 conn(0x7fc9f00b0270 legacy=0x7fc9f0156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9efe00640 1 -- 172.21.15.149:0/1207061251 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0157040 con 0x7fc9f0158b30 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.991+0000 7fc9ef400640 1 --2- 172.21.15.149:0/1207061251 >> v2:172.21.15.161:3300/0 conn(0x7fc9f0155900 0x7fc9f0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:03.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.992+0000 7fc9efe00640 1 --2- 172.21.15.149:0/1207061251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 0x7fc9f00ae6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009f20 tx=0x7fc9e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d036f267cdf0b021 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.992+0000 7fc9eea00640 1 -- 172.21.15.149:0/1207061251 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8031400 con 0x7fc9f0158b30 2024-08-17T02:47:03.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.992+0000 7fc9eea00640 1 -- 172.21.15.149:0/1207061251 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e802d050 con 0x7fc9f0158b30 2024-08-17T02:47:03.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.992+0000 7fc9eea00640 1 -- 172.21.15.149:0/1207061251 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80317d0 con 0x7fc9f0158b30 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 -- 172.21.15.149:0/1207061251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 msgr2=0x7fc9f00ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/1207061251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 0x7fc9f00ae6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009f20 tx=0x7fc9e8009840 comp rx=0 tx=0).stop 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 -- 172.21.15.149:0/1207061251 shutdown_connections 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/1207061251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0158b30 0x7fc9f00ae6b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/1207061251 >> v2:172.21.15.161:3300/0 conn(0x7fc9f0155900 0x7fc9f0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 -- 172.21.15.149:0/1207061251 >> 172.21.15.149:0/1207061251 conn(0x7fc9f0067750 msgr2=0x7fc9f00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 -- 172.21.15.149:0/1207061251 shutdown_connections 2024-08-17T02:47:03.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.993+0000 7fc9f4e00640 1 -- 172.21.15.149:0/1207061251 wait complete. 2024-08-17T02:47:03.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.995+0000 7fc9f4e00640 1 Processor -- start 2024-08-17T02:47:03.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.995+0000 7fc9f4e00640 1 -- start start 2024-08-17T02:47:03.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.995+0000 7fc9f4e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f00b0270 0x7fc9f00c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.995+0000 7fc9f4e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0155900 0x7fc9f0167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.995+0000 7fc9f4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9f0158b30 0x7fc9f00c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9f4e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c48e0 con 0x7fc9f0158b30 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9f4e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c3cd0 con 0x7fc9f00b0270 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9f4e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c3fb0 con 0x7fc9f0155900 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9f0158b30 0x7fc9f00c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9ef400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f00b0270 0x7fc9f00c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9e6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0155900 0x7fc9f0167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9ef400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f00b0270 0x7fc9f00c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:58482/0 (socket says 172.21.15.149:58482) 2024-08-17T02:47:03.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9ef400640 1 -- 172.21.15.149:0/4064156538 learned_addr learned my addr 172.21.15.149:0/4064156538 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9e6a00640 1 -- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f00b0270 msgr2=0x7fc9f00c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f00b0270 0x7fc9f00c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9e6a00640 1 -- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9f0158b30 msgr2=0x7fc9f00c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9f0158b30 0x7fc9f00c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9e6a00640 1 -- 172.21.15.149:0/4064156538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0009390 con 0x7fc9f0155900 2024-08-17T02:47:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.996+0000 7fc9efe00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9f0158b30 0x7fc9f00c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.997+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0155900 0x7fc9f0167590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800c4b0 tx=0x7fc9d8007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.997+0000 7fc9e7400640 1 -- 172.21.15.149:0/4064156538 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011590 con 0x7fc9f0155900 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.997+0000 7fc9e7400640 1 -- 172.21.15.149:0/4064156538 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d80116f0 con 0x7fc9f0155900 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.997+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8009ae0 con 0x7fc9f0155900 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.997+0000 7fc9e7400640 1 -- 172.21.15.149:0/4064156538 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011ab0 con 0x7fc9f0155900 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.997+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00c4570 con 0x7fc9f0155900 2024-08-17T02:47:03.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:03.999+0000 7fc9e7400640 1 -- 172.21.15.149:0/4064156538 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc9d801b3b0 con 0x7fc9f0155900 2024-08-17T02:47:04.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.000+0000 7fc9e7400640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9cc065150 0x7fc9cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.000+0000 7fc9e7400640 1 -- 172.21.15.149:0/4064156538 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9d8081920 con 0x7fc9f0155900 2024-08-17T02:47:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.000+0000 7fc9ef400640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9cc065150 0x7fc9cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.000+0000 7fc9f89a7740 1 Processor -- start 2024-08-17T02:47:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 -- start start 2024-08-17T02:47:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9ef400640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9cc065150 0x7fc9cc067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009fb0 tx=0x7fc9e00090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988219760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557988191380 con 0x557988219ca0 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55798813a9e0 con 0x5579881fbbc0 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x557988138170 con 0x5579881d7230 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.001+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44360/0 (socket says 172.21.15.149:44360) 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 -- 172.21.15.149:0/2863610258 learned_addr learned my addr 172.21.15.149:0/2863610258 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9ef400640 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988219760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 -- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 msgr2=0x557988219760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988219760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 -- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 msgr2=0x5579881fbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881fbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 -- 172.21.15.149:0/2863610258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579880e7820 con 0x557988219ca0 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9ef400640 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9efe00640 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881d0a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009f80 tx=0x7fc9e8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcaf599f8592cba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.002+0000 7fc9df400640 1 -- 172.21.15.149:0/2863610258 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80317c0 con 0x557988219ca0 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9df400640 1 -- 172.21.15.149:0/2863610258 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8040070 con 0x557988219ca0 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9df400640 1 -- 172.21.15.149:0/2863610258 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8045430 con 0x557988219ca0 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2863610258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 msgr2=0x5579881d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881d0a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009f80 tx=0x7fc9e8036000 comp rx=0 tx=0).stop 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2863610258 shutdown_connections 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881d0a90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988219760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2863610258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2863610258 >> 172.21.15.149:0/2863610258 conn(0x55798816f030 msgr2=0x55798821de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2863610258 shutdown_connections 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.003+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2863610258 wait complete. 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.004+0000 7fc9f89a7740 1 -- start start 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.004+0000 7fc9f89a7740 1 Processor -- start 2024-08-17T02:47:04.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 0x5579882015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881fbbc0 0x5579881d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557988133f60 con 0x5579881d7230 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579880dc690 con 0x557988219ca0 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579880dc330 con 0x5579881fbbc0 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9f89a7740 10 client.0 _ll_register_callbacks cb 0x5579880d62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9ef400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 0x5579882015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9ef400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 0x5579882015b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44376/0 (socket says 172.21.15.149:44376) 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9ef400640 1 -- 172.21.15.149:0/2417812292 learned_addr learned my addr 172.21.15.149:0/2417812292 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.005+0000 7fc9ef400640 1 -- 172.21.15.149:0/2417812292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881fbbc0 msgr2=0x5579881d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9ef400640 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881fbbc0 0x5579881d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9ef400640 1 -- 172.21.15.149:0/2417812292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 msgr2=0x5579882292d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9ef400640 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9ef400640 1 -- 172.21.15.149:0/2417812292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f0157040 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9ef400640 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 0x5579882015b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0011ed0 tx=0x7fc9e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71f8b0d1349a861 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9d3e00640 1 -- 172.21.15.149:0/2417812292 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0013c50 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9d3e00640 1 -- 172.21.15.149:0/2417812292 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9e001a040 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557988167d20 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9d3e00640 1 -- 172.21.15.149:0/2417812292 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e002a460 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9f89a7740 10 client.4647 fetch_fsmap learned FSMap version 8 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.006+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5579880fdab0 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9d3e00640 1 -- 172.21.15.149:0/2417812292 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0031070 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9d3e00640 1 -- 172.21.15.149:0/2417812292 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc9e00213f0 con 0x5579881d7230 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9f89a7740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9f89a7740 10 client.4647 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9f89a7740 20 client.4647 populate_metadata read hostname 'smithi149' 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x5579881f8940 0x5579881f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9f89a7740 4 client.4647 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 --> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557987e3b3c0 con 0x5579881f8940 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x5579881f8940 0x5579881f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x5579881f8940 0x5579881f8d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca98dbdac8b3bcf6 server_cookie=d950c8b328110c3 in_seq=0 out_seq=0 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.007+0000 7fc9d3e00640 10 client.4647 ms_handle_connect on v2:172.21.15.149:6834/4028834101 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.008+0000 7fc9d3e00640 1 -- 172.21.15.149:0/2417812292 <== mds.0 v2:172.21.15.149:6834/4028834101 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x557987e3b3c0 con 0x5579881f8940 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.008+0000 7fc9d3e00640 10 client.4647 handle_command_reply: tid=0 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.008+0000 7fc9f89a7740 1 client.4647 shutdown 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.008+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 msgr2=0x5579882015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.008+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 0x5579882015b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0011ed0 tx=0x7fc9e0019000 comp rx=0 tx=0).stop 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 shutdown_connections 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882292d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881fbbc0 0x5579881d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x5579881f8940 0x5579881f8d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/2417812292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881d7230 0x5579882015b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 >> 172.21.15.149:0/2417812292 conn(0x55798816f030 msgr2=0x557988217a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9d3e00640 0 client.4647 ms_handle_reset on v2:172.21.15.149:6834/4028834101 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 shutdown_connections 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 1 -- 172.21.15.149:0/2417812292 wait complete. 2024-08-17T02:47:04.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.009+0000 7fc9f89a7740 20 client.4647 trim_cache size 0 max 16384 2024-08-17T02:47:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.024+0000 7fc9f89a7740 1 Processor -- start 2024-08-17T02:47:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.024+0000 7fc9f89a7740 1 -- start start 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x5579881d4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 0x557988233b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557987eaef20 con 0x5579881fbbc0 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579881d6710 con 0x557988219ca0 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x557988217860 con 0x5579881d7230 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.025+0000 7fc9e6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 0x557988233b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 0x557988233b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44378/0 (socket says 172.21.15.149:44378) 2024-08-17T02:47:04.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 -- 172.21.15.149:0/1319702796 learned_addr learned my addr 172.21.15.149:0/1319702796 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9efe00640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9ef400640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x5579881d4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 -- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 msgr2=0x5579881d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x5579881d4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 -- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 msgr2=0x5579882034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 -- 172.21.15.149:0/1319702796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557988101490 con 0x5579881fbbc0 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9efe00640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9ef400640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x5579881d4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 0x557988233b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8003f10 tx=0x7fc9d801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dbbc4310dc7060 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9dfe00640 1 -- 172.21.15.149:0/1319702796 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d805a5a0 con 0x5579881fbbc0 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9dfe00640 1 -- 172.21.15.149:0/1319702796 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d8068070 con 0x5579881fbbc0 2024-08-17T02:47:04.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.026+0000 7fc9dfe00640 1 -- 172.21.15.149:0/1319702796 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d807feb0 con 0x5579881fbbc0 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 -- 172.21.15.149:0/1319702796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 msgr2=0x557988233b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 0x557988233b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8003f10 tx=0x7fc9d801e040 comp rx=0 tx=0).stop 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 -- 172.21.15.149:0/1319702796 shutdown_connections 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557988219ca0 0x5579882034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579881fbbc0 0x557988233b20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/1319702796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x5579881d4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 -- 172.21.15.149:0/1319702796 >> 172.21.15.149:0/1319702796 conn(0x55798816f030 msgr2=0x5579881f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 -- 172.21.15.149:0/1319702796 shutdown_connections 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.027+0000 7fc9f89a7740 1 -- 172.21.15.149:0/1319702796 wait complete. 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.028+0000 7fc9f89a7740 1 -- start start 2024-08-17T02:47:04.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.028+0000 7fc9f89a7740 1 Processor -- start 2024-08-17T02:47:04.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988281190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579881cfff0 con 0x557988219ca0 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557988282dc0 con 0x5579881fbbc0 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579881cfac0 con 0x5579881d7230 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9f89a7740 10 client.0 _ll_register_callbacks cb 0x7fc9e0009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881f7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44388/0 (socket says 172.21.15.149:44388) 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 -- 172.21.15.149:0/3473900303 learned_addr learned my addr 172.21.15.149:0/3473900303 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9ef400640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988281190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 -- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 msgr2=0x557988281190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988281190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 -- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 msgr2=0x5579881f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9efe00640 1 -- 172.21.15.149:0/3473900303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00c4570 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9e6a00640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.029+0000 7fc9ef400640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988281190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9efe00640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881f7f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9e802acb0 tx=0x7fc9e803e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49da6fdb2062b8a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9d3e00640 1 -- 172.21.15.149:0/3473900303 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8045430 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9d3e00640 1 -- 172.21.15.149:0/3473900303 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9e80319d0 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9e8040070 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9d3e00640 1 -- 172.21.15.149:0/3473900303 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e8045a30 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 10 client.4653 fetch_fsmap learned FSMap version 8 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5579881011e0 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9d3e00640 1 -- 172.21.15.149:0/3473900303 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8040070 con 0x557988219ca0 2024-08-17T02:47:04.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9d3e00640 1 -- 172.21.15.149:0/3473900303 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc9e8045b90 con 0x557988219ca0 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 20 client.4653 populate_metadata read hostname 'smithi149' 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x557988281bd0 0x557988281fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 4 client.4653 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.030+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 --> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557987e4c6c0 con 0x557988281bd0 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.031+0000 7fc9ef400640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x557988281bd0 0x557988281fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.031+0000 7fc9ef400640 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x557988281bd0 0x557988281fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402115c9f7b7b11f server_cookie=39c1231606c924e6 in_seq=0 out_seq=0 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.031+0000 7fc9d3e00640 10 client.4653 ms_handle_connect on v2:172.21.15.149:6834/4028834101 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.031+0000 7fc9d3e00640 1 -- 172.21.15.149:0/3473900303 <== mds.0 v2:172.21.15.149:6834/4028834101 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557987e4c6c0 con 0x557988281bd0 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.031+0000 7fc9d3e00640 10 client.4653 handle_command_reply: tid=0 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.031+0000 7fc9f89a7740 1 client.4653 shutdown 2024-08-17T02:47:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 msgr2=0x5579881f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881f7f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9e802acb0 tx=0x7fc9e803e070 comp rx=0 tx=0).stop 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 shutdown_connections 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:6834/4028834101,v1:172.21.15.149:6835/4028834101] conn(0x557988281bd0 0x557988281fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557988219ca0 0x5579881f7f80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579881fbbc0 0x5579881f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 --2- 172.21.15.149:0/3473900303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5579881d7230 0x557988281190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9d3e00640 0 client.4653 ms_handle_reset on v2:172.21.15.149:6834/4028834101 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 >> 172.21.15.149:0/3473900303 conn(0x55798816f030 msgr2=0x557988201440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 shutdown_connections 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 1 -- 172.21.15.149:0/3473900303 wait complete. 2024-08-17T02:47:04.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f89a7740 20 client.4653 trim_cache size 0 max 16384 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "b8d2e793-20e6-428a-8b1c-2d641058b12a", 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4290, 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 14.971306308000001, 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 8, 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 22, 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 22, 2024-08-17T02:47:04.039 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 22.015265175 2024-08-17T02:47:04.040 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:47:04.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9cc065150 msgr2=0x7fc9cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9cc065150 0x7fc9cc067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009fb0 tx=0x7fc9e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0155900 msgr2=0x7fc9f0167590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.032+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0155900 0x7fc9f0167590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800c4b0 tx=0x7fc9d8007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 shutdown_connections 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc9cc065150 0x7fc9cc067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9f0158b30 0x7fc9f00c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9f0155900 0x7fc9f0167590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 --2- 172.21.15.149:0/4064156538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f00b0270 0x7fc9f00c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 >> 172.21.15.149:0/4064156538 conn(0x7fc9f0067750 msgr2=0x7fc9f0069380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 shutdown_connections 2024-08-17T02:47:04.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.033+0000 7fc9f4e00640 1 -- 172.21.15.149:0/4064156538 wait complete. 2024-08-17T02:47:04.048 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:47:04.074 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:47:04.074 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:47:04.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.075 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:47:04.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-08-17T02:47:04.212 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:04.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:04.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.215 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:47:04.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-08-17T02:47:04.350 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:04.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:04.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.353 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:47:04.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-08-17T02:47:04.497 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:04.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:04.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.500 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:47:04.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:04.537 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-08-17T02:47:04.636 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:04.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:04.639 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:47:04.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:04.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.788+0000 7f0d64600640 1 Processor -- start 2024-08-17T02:47:04.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.788+0000 7f0d64600640 1 -- start start 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.789+0000 7f0d64600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d5c155a20 0x7f0d5c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.789+0000 7f0d64600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0d5c155df0 0x7f0d5c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.789+0000 7f0d64600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c156670 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.789+0000 7f0d64600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0b0350 con 0x7f0d5c155a20 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.789+0000 7f0d64600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c06e5e0 con 0x7f0d5c155df0 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d5c155a20 0x7f0d5c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d62600640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0d5c06d7f0 0x7f0d5c0ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38102/0 (socket says 172.21.15.149:38102) 2024-08-17T02:47:04.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d5c155a20 0x7f0d5c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44402/0 (socket says 172.21.15.149:44402) 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d62600640 1 -- 172.21.15.149:0/1502492829 learned_addr learned my addr 172.21.15.149:0/1502492829 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61200640 1 --2- 172.21.15.149:0/1502492829 >> v2:172.21.15.161:3300/0 conn(0x7f0d5c155df0 0x7f0d5c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61c00640 1 -- 172.21.15.149:0/1502492829 >> v2:172.21.15.161:3300/0 conn(0x7f0d5c155df0 msgr2=0x7f0d5c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61c00640 1 --2- 172.21.15.149:0/1502492829 >> v2:172.21.15.161:3300/0 conn(0x7f0d5c155df0 0x7f0d5c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61c00640 1 -- 172.21.15.149:0/1502492829 >> v1:172.21.15.149:6789/0 conn(0x7f0d5c06d7f0 legacy=0x7f0d5c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61c00640 1 -- 172.21.15.149:0/1502492829 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c06e8c0 con 0x7f0d5c155a20 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d61200640 1 --2- 172.21.15.149:0/1502492829 >> v2:172.21.15.161:3300/0 conn(0x7f0d5c155df0 0x7f0d5c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:04.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.790+0000 7f0d5be00640 1 -- 172.21.15.149:0/1502492829 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625308376 0 0) 0x7f0d5c156670 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.791+0000 7f0d61c00640 1 --2- 172.21.15.149:0/1502492829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c155a20 0x7f0d5c0adf10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c06aa10 tx=0x7f0d500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b237db1b99472c72 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.791+0000 7f0d5be00640 1 -- 172.21.15.149:0/1502492829 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5002adb0 con 0x7f0d5c155a20 2024-08-17T02:47:04.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.791+0000 7f0d5be00640 1 -- 172.21.15.149:0/1502492829 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50032440 con 0x7f0d5c155a20 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.791+0000 7f0d5be00640 1 -- 172.21.15.149:0/1502492829 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500327e0 con 0x7f0d5c155a20 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 -- 172.21.15.149:0/1502492829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c155a20 msgr2=0x7f0d5c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 --2- 172.21.15.149:0/1502492829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c155a20 0x7f0d5c0adf10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c06aa10 tx=0x7f0d500090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 -- 172.21.15.149:0/1502492829 shutdown_connections 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 --2- 172.21.15.149:0/1502492829 >> v2:172.21.15.161:3300/0 conn(0x7f0d5c155df0 0x7f0d5c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 --2- 172.21.15.149:0/1502492829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c155a20 0x7f0d5c0adf10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 -- 172.21.15.149:0/1502492829 >> 172.21.15.149:0/1502492829 conn(0x7f0d5c0cb9b0 msgr2=0x7f0d5c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 -- 172.21.15.149:0/1502492829 shutdown_connections 2024-08-17T02:47:04.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.792+0000 7f0d64600640 1 -- 172.21.15.149:0/1502492829 wait complete. 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.794+0000 7f0d64600640 1 Processor -- start 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.794+0000 7f0d64600640 1 -- start start 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.794+0000 7f0d64600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 0x7f0d5c13d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.794+0000 7f0d64600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d5c155a20 0x7f0d5c069b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d64600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d5c155df0 0x7f0d5c06a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d64600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0a85c0 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d64600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0ae200 con 0x7f0d5c155a20 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d64600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0ad960 con 0x7f0d5c155df0 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 0x7f0d5c13d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 0x7f0d5c13d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44416/0 (socket says 172.21.15.149:44416) 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d5c155a20 0x7f0d5c069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 -- 172.21.15.149:0/2447321894 learned_addr learned my addr 172.21.15.149:0/2447321894 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d62600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d5c155df0 0x7f0d5c06a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 -- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d5c155df0 msgr2=0x7f0d5c06a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d5c155df0 0x7f0d5c06a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 -- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d5c155a20 msgr2=0x7f0d5c069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d5c155a20 0x7f0d5c069b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.795+0000 7f0d61c00640 1 -- 172.21.15.149:0/2447321894 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009390 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.796+0000 7f0d61c00640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 0x7f0d5c13d7e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009360 tx=0x7f0d50032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.796+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50031de0 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.796+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5003d420 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.796+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5003d7c0 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.796+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c0adc40 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.796+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c0a8d30 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.797+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c064db0 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.798+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0d50039040 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.798+0000 7f0d58c00640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d3c065150 0x7f0d3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.798+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d500a2960 con 0x7f0d5c06d7f0 2024-08-17T02:47:04.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.799+0000 7f0d61200640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d3c065150 0x7f0d3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.799+0000 7f0d61200640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d3c065150 0x7f0d3c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c16c5b0 tx=0x7f0d48008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:04.803+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0d50070af0 con 0x7f0d5c06d7f0 2024-08-17T02:47:05.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.009+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d5c06b170 con 0x7f0d5c06d7f0 2024-08-17T02:47:05.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.010+0000 7f0d58c00640 1 -- 172.21.15.149:0/2447321894 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d50037070 con 0x7f0d5c06d7f0 2024-08-17T02:47:05.011 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d3c065150 msgr2=0x7f0d3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d3c065150 0x7f0d3c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c16c5b0 tx=0x7f0d48008040 comp rx=0 tx=0).stop 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 msgr2=0x7f0d5c13d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 0x7f0d5c13d7e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009360 tx=0x7f0d50032000 comp rx=0 tx=0).stop 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 shutdown_connections 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d3c065150 0x7f0d3c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d5c155df0 0x7f0d5c06a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d5c155a20 0x7f0d5c069b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 --2- 172.21.15.149:0/2447321894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d5c06d7f0 0x7f0d5c13d7e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 >> 172.21.15.149:0/2447321894 conn(0x7f0d5c0cb9b0 msgr2=0x7f0d5c06c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:05.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 shutdown_connections 2024-08-17T02:47:05.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:05.012+0000 7f0d64600640 1 -- 172.21.15.149:0/2447321894 wait complete. 2024-08-17T02:47:05.027 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:05.027 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:05.027 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-08-17T02:47:05.027 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:47:05.028 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:05.028 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:05.028 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:05.028 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:05.028 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:05.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:05.028 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-08-17T02:47:05.063 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42653sec preferred_lft 42653sec 2024-08-17T02:47:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-08-17T02:47:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:05.065 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:47:05.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:05.065 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:05.065 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:05.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:47:05.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-08-17T02:47:05.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-08-17T02:47:05.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:47:05.066 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:05.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:05.425 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:05.481 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-08-17T02:47:05.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:05.485 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-08-17T02:47:05.554 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-08-17T02:47:05.555 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:05.555 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:05.555 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:05.555 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:05.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:05.556 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:05.556 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:05.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:05.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:05.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:05.556 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:06.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:06.125 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:47:06.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:06.161 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-08-17T02:47:06.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:06.238 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:06.238 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:06.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:06.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:47:06.238 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:06.366 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:47:06.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:47:06.367 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:06.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:06.554 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:06.554 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:06.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-08-17T02:47:06.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:47:06.554 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:06.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:06.670 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:06.706 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:06.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:06.706 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:06.781 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:47:06.781 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:06.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:06.913 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:06.913 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:07.507 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:07.507 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:07.507 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-08-17T02:47:07.507 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 0@b8d2e793-20e6-428a-8b1c-2d641058b12a.cephfs=/ 2024-08-17T02:47:07.507 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.149:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-08-17T02:47:07.509 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:47:07.509 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:07.509 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:07.509 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:07.509 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:07.512 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:07.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:07.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:07.569 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:47:07.569 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:07.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.718+0000 7f7706800640 1 Processor -- start 2024-08-17T02:47:07.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.718+0000 7f7706800640 1 -- start start 2024-08-17T02:47:07.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.719+0000 7f7706800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 0x7f77000caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.719+0000 7f7706800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7700140580 0x7f77000b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.719+0000 7f7706800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000b16d0 con 0x7f77000b1270 2024-08-17T02:47:07.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.719+0000 7f7706800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000cb450 con 0x7f7700140580 2024-08-17T02:47:07.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.719+0000 7f7706800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000caa80 con 0x7f77001401b0 2024-08-17T02:47:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.720+0000 7f76ff400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 0x7f77000caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.720+0000 7f76f6a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7700140580 0x7f77000b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.720+0000 7f76ffe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f77000b1270 0x7f77000c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:46334/0 (socket says 172.21.15.149:46334) 2024-08-17T02:47:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.720+0000 7f76ffe00640 1 -- 172.21.15.149:0/1469552156 learned_addr learned my addr 172.21.15.149:0/1469552156 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.720+0000 7f76ff400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 0x7f77000caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:60490/0 (socket says 172.21.15.149:60490) 2024-08-17T02:47:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.721+0000 7f76ff400640 1 -- 172.21.15.149:0/1469552156 >> v2:172.21.15.161:3300/0 conn(0x7f7700140580 msgr2=0x7f77000b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.721+0000 7f76ff400640 1 --2- 172.21.15.149:0/1469552156 >> v2:172.21.15.161:3300/0 conn(0x7f7700140580 0x7f77000b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.721+0000 7f76ff400640 1 -- 172.21.15.149:0/1469552156 >> v1:172.21.15.161:6789/0 conn(0x7f77000b1270 legacy=0x7f77000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.721+0000 7f76ff400640 1 -- 172.21.15.149:0/1469552156 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000c9e70 con 0x7f77001401b0 2024-08-17T02:47:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.721+0000 7f76f6a00640 1 --2- 172.21.15.149:0/1469552156 >> v2:172.21.15.161:3300/0 conn(0x7f7700140580 0x7f77000b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.722+0000 7f76ff400640 1 --2- 172.21.15.149:0/1469552156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 0x7f77000caf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009850 tx=0x7f76f00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8894a0508901e069 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.722+0000 7f76fea00640 1 -- 172.21.15.149:0/1469552156 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f002ad00 con 0x7f77001401b0 2024-08-17T02:47:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.722+0000 7f76fea00640 1 -- 172.21.15.149:0/1469552156 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f002ae60 con 0x7f77001401b0 2024-08-17T02:47:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.722+0000 7f76fea00640 1 -- 172.21.15.149:0/1469552156 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0032670 con 0x7f77001401b0 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 -- 172.21.15.149:0/1469552156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 msgr2=0x7f77000caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 --2- 172.21.15.149:0/1469552156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 0x7f77000caf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009850 tx=0x7f76f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 -- 172.21.15.149:0/1469552156 shutdown_connections 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 --2- 172.21.15.149:0/1469552156 >> v2:172.21.15.161:3300/0 conn(0x7f7700140580 0x7f77000b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 --2- 172.21.15.149:0/1469552156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77001401b0 0x7f77000caf10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 -- 172.21.15.149:0/1469552156 >> 172.21.15.149:0/1469552156 conn(0x7f77000cb9b0 msgr2=0x7f77000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 -- 172.21.15.149:0/1469552156 shutdown_connections 2024-08-17T02:47:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.723+0000 7f7706800640 1 -- 172.21.15.149:0/1469552156 wait complete. 2024-08-17T02:47:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.724+0000 7f7706800640 1 Processor -- start 2024-08-17T02:47:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.725+0000 7f7706800640 1 -- start start 2024-08-17T02:47:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.725+0000 7f7706800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77000b1270 0x7f77000af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.725+0000 7f7706800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 0x7f77000aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.725+0000 7f7706800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7700140580 0x7f7700168fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.725+0000 7f7706800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000aeb20 con 0x7f77001401b0 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f7706800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700169a80 con 0x7f77000b1270 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f7706800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700169d60 con 0x7f7700140580 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 0x7f77000aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76ff400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77000b1270 0x7f77000af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 0x7f77000aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52596/0 (socket says 172.21.15.149:52596) 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 -- 172.21.15.149:0/1633660638 learned_addr learned my addr 172.21.15.149:0/1633660638 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76ffe00640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7700140580 0x7f7700168fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 -- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7700140580 msgr2=0x7f7700168fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7700140580 0x7f7700168fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 -- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77000b1270 msgr2=0x7f77000af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77000b1270 0x7f77000af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.726+0000 7f76f6a00640 1 -- 172.21.15.149:0/1633660638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009390 con 0x7f77001401b0 2024-08-17T02:47:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.727+0000 7f76f6a00640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 0x7f77000aa710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f76e800ec80 tx=0x7f76e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.727+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800eec0 con 0x7f77001401b0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.727+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e800cbc0 con 0x7f77001401b0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.727+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8013470 con 0x7f77001401b0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.727+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0009390 con 0x7f77001401b0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.727+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77000af050 con 0x7f77001401b0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.728+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7700064db0 con 0x7f77001401b0 2024-08-17T02:47:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.729+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f76e80137e0 con 0x7f77001401b0 2024-08-17T02:47:07.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.730+0000 7f76f7400640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f76dc065150 0x7f76dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.730+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76e8082840 con 0x7f77001401b0 2024-08-17T02:47:07.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.730+0000 7f76ff400640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f76dc065150 0x7f76dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.731+0000 7f76ff400640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f76dc065150 0x7f76dc067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f76f0034000 tx=0x7f76f0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.734+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f76e8050910 con 0x7f77001401b0 2024-08-17T02:47:07.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.943+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77000cc060 con 0x7f77001401b0 2024-08-17T02:47:07.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.944+0000 7f76f7400640 1 -- 172.21.15.149:0/1633660638 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76e8053f30 con 0x7f77001401b0 2024-08-17T02:47:07.945 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:07.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f76dc065150 msgr2=0x7f76dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f76dc065150 0x7f76dc067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f76f0034000 tx=0x7f76f0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 msgr2=0x7f77000aa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 0x7f77000aa710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f76e800ec80 tx=0x7f76e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 shutdown_connections 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f76dc065150 0x7f76dc067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7700140580 0x7f7700168fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77001401b0 0x7f77000aa710 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 --2- 172.21.15.149:0/1633660638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77000b1270 0x7f77000af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 >> 172.21.15.149:0/1633660638 conn(0x7f77000cb9b0 msgr2=0x7f770013f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 shutdown_connections 2024-08-17T02:47:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:07.946+0000 7f7706800640 1 -- 172.21.15.149:0/1633660638 wait complete. 2024-08-17T02:47:07.961 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:07.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:07.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-08-17T02:47:07.962 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:47:07.962 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:07.962 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:07.962 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:07.962 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:07.962 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:47:07.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:07.962 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-08-17T02:47:07.998 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:07.998 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:07.999 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42650sec preferred_lft 42650sec 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 7e:63:94:ef:0b:68 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.000 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::2c58:f4ff:fe1a:1834/64 scope link 2024-08-17T02:47:08.001 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.001 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:08.001 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 7e:63:94:ef:0b:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:08.001 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::7c63:94ff:feef:b68/64 scope link tentative 2024-08-17T02:47:08.001 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.002 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:08.093 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-08-17T02:47:08.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.096 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-08-17T02:47:08.132 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-08-17T02:47:08.132 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:08.132 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:08.132 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:08.132 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:08.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.133 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:08.133 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:08.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:08.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:08.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:08.133 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:08.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.279 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:47:08.315 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:47:08.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.316 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-08-17T02:47:08.390 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:47:08.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.391 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:08.391 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:08.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:47:08.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:47:08.391 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:08.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:47:08.571 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether fa:8b:8e:5e:61:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::f88b:8eff:fe5e:6191/64 scope link tentative 2024-08-17T02:47:08.572 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether fa:8b:8e:5e:61:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:08.631 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:08.631 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.631 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::f88b:8eff:fe5e:6191/64 scope link tentative 2024-08-17T02:47:08.631 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:08.634 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:47:08.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.634 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:47:08.635 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:08.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:08.803 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:08.803 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:08.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2024-08-17T02:47:08.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:47:08.803 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:08.918 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:08.953 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:47:08.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:08.953 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:09.029 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:47:09.029 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:09.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:09.151 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:09.151 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:09.179 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:09.179 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:09.179 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-08-17T02:47:09.179 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 2@b8d2e793-20e6-428a-8b1c-2d641058b12a.cephfs=/ 2024-08-17T02:47:09.179 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.149:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-08-17T02:47:09.180 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:47:09.180 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:09.180 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:09.180 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:09.180 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:09.185 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:09.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:09.186 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:09.241 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:47:09.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:09.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.389+0000 7f63c6c00640 1 Processor -- start 2024-08-17T02:47:09.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.389+0000 7f63c6c00640 1 -- start start 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.390+0000 7f63c6c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f63c0066cd0 0x7f63c00670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63c6c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c015a080 0x7f63c01629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63c6c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00675e0 con 0x7f63c0069740 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63c6c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c0069eb0 con 0x7f63c0066cd0 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63c6c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c006c230 con 0x7f63c015a080 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f63c0066cd0 0x7f63c00670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f63c0066cd0 0x7f63c00670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52610/0 (socket says 172.21.15.149:52610) 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 -- 172.21.15.149:0/4159395670 learned_addr learned my addr 172.21.15.149:0/4159395670 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63c4c00640 1 --2- 172.21.15.149:0/4159395670 >> v2:172.21.15.161:3300/0 conn(0x7f63c015a080 0x7f63c01629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 -- 172.21.15.149:0/4159395670 >> v2:172.21.15.161:3300/0 conn(0x7f63c015a080 msgr2=0x7f63c01629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 --2- 172.21.15.149:0/4159395670 >> v2:172.21.15.161:3300/0 conn(0x7f63c015a080 0x7f63c01629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 -- 172.21.15.149:0/4159395670 >> v1:172.21.15.161:6789/0 conn(0x7f63c0069740 legacy=0x7f63c00cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.391+0000 7f63bfe00640 1 -- 172.21.15.149:0/4159395670 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0069bd0 con 0x7f63c0066cd0 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.392+0000 7f63bfe00640 1 --2- 172.21.15.149:0/4159395670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c0066cd0 0x7f63c00670a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63c00c8ec0 tx=0x7f63b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ae517a1019070 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63bf400640 1 -- 172.21.15.149:0/4159395670 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b002ae80 con 0x7f63c0066cd0 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63bf400640 1 -- 172.21.15.149:0/4159395670 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0032440 con 0x7f63c0066cd0 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63bf400640 1 -- 172.21.15.149:0/4159395670 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0032800 con 0x7f63c0066cd0 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 -- 172.21.15.149:0/4159395670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c0066cd0 msgr2=0x7f63c00670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 --2- 172.21.15.149:0/4159395670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c0066cd0 0x7f63c00670a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63c00c8ec0 tx=0x7f63b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 -- 172.21.15.149:0/4159395670 shutdown_connections 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 --2- 172.21.15.149:0/4159395670 >> v2:172.21.15.161:3300/0 conn(0x7f63c015a080 0x7f63c01629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 --2- 172.21.15.149:0/4159395670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c0066cd0 0x7f63c00670a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 -- 172.21.15.149:0/4159395670 >> 172.21.15.149:0/4159395670 conn(0x7f63c0068820 msgr2=0x7f63c00cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 -- 172.21.15.149:0/4159395670 shutdown_connections 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.393+0000 7f63c6c00640 1 -- 172.21.15.149:0/4159395670 wait complete. 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.395+0000 7f63c6c00640 1 Processor -- start 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.395+0000 7f63c6c00640 1 -- start start 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c6c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63c0066cd0 0x7f63c00aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c6c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c0069740 0x7f63c0146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c6c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 0x7f63c0147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c6c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01479c0 con 0x7f63c015a080 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c6c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01540c0 con 0x7f63c0069740 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c6c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01534b0 con 0x7f63c0066cd0 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 0x7f63c0147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 0x7f63c0147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52624/0 (socket says 172.21.15.149:52624) 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 -- 172.21.15.149:0/2791110783 learned_addr learned my addr 172.21.15.149:0/2791110783 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63bfe00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63c0066cd0 0x7f63c00aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63b7e00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c0069740 0x7f63c0146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 -- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63c0066cd0 msgr2=0x7f63c00aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63c0066cd0 0x7f63c00aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 -- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c0069740 msgr2=0x7f63c0146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c0069740 0x7f63c0146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63c4c00640 1 -- 172.21.15.149:0/2791110783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009450 con 0x7f63c015a080 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.396+0000 7f63b7e00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c0069740 0x7f63c0146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.397+0000 7f63c4c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 0x7f63c0147480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009d70 tx=0x7f63b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.397+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800cdd0 con 0x7f63c015a080 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.397+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800f040 con 0x7f63c015a080 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.397+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c0153790 con 0x7f63c015a080 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.397+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80146d0 con 0x7f63c015a080 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.397+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0153d50 con 0x7f63c015a080 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.398+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0063d20 con 0x7f63c015a080 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.399+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f63b8014a40 con 0x7f63c015a080 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.400+0000 7f63b7400640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f639c0651d0 0x7f639c067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.400+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63b8083130 con 0x7f63c015a080 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.400+0000 7f63bfe00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f639c0651d0 0x7f639c067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.401+0000 7f63bfe00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f639c0651d0 0x7f639c067680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63b0034000 tx=0x7f63b0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.404+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63b8051210 con 0x7f63c015a080 2024-08-17T02:47:09.550 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:09.555 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:09.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.621+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63c0154200 con 0x7f63c015a080 2024-08-17T02:47:09.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.621+0000 7f63b7400640 1 -- 172.21.15.149:0/2791110783 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63c0154200 con 0x7f63c015a080 2024-08-17T02:47:09.622 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f639c0651d0 msgr2=0x7f639c067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f639c0651d0 0x7f639c067680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63b0034000 tx=0x7f63b0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 msgr2=0x7f63c0147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 0x7f63c0147480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009d70 tx=0x7f63b800b040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 shutdown_connections 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f639c0651d0 0x7f639c067680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c015a080 0x7f63c0147480 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c0069740 0x7f63c0146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 --2- 172.21.15.149:0/2791110783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63c0066cd0 0x7f63c00aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 >> 172.21.15.149:0/2791110783 conn(0x7f63c0068820 msgr2=0x7f63c00af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 shutdown_connections 2024-08-17T02:47:09.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:09.624+0000 7f63c6c00640 1 -- 172.21.15.149:0/2791110783 wait complete. 2024-08-17T02:47:09.640 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:09.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:09.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-08-17T02:47:09.640 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:47:09.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:09.641 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:09.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:09.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:09.641 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:09.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:09.641 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:09.679 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-08-17T02:47:09.680 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:09.681 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:47:09.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:47:09.681 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:10.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.033 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:10.092 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-08-17T02:47:10.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.096 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-08-17T02:47:10.146 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-08-17T02:47:10.146 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:10.146 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:10.146 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:10.146 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:10.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.146 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:10.146 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:10.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:10.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:10.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:10.147 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.673 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:47:10.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.708 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-08-17T02:47:10.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.784 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:10.784 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:10.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:10.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:47:10.784 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:10.910 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:47:10.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:10.910 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:47:10.911 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:11.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:11.100 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:11.100 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:11.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-08-17T02:47:11.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:47:11.101 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:11.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:11.218 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:11.253 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:11.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:11.253 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:11.328 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:47:11.328 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:11.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:11.458 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:11.459 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:12.070 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:12.071 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:12.071 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-08-17T02:47:12.071 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 1@b8d2e793-20e6-428a-8b1c-2d641058b12a.cephfs=/ 2024-08-17T02:47:12.071 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.149:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-08-17T02:47:12.072 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:47:12.072 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:12.072 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:12.072 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:12.072 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:12.075 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:12.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.075 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:12.132 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:47:12.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:12.292 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.292+0000 7efc87600640 1 Processor -- start 2024-08-17T02:47:12.293 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.292+0000 7efc87600640 1 -- start start 2024-08-17T02:47:12.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc87600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c230 0x7efc8006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc87600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc8015c600 0x7efc8006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc87600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc80066cd0 0x7efc80067130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc87600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc80067670 con 0x7efc8015c600 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc87600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8006b9d0 con 0x7efc80066cd0 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc87600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800aad80 con 0x7efc8015c230 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc7fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc8015c600 0x7efc8006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc7fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc8015c600 0x7efc8006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52634/0 (socket says 172.21.15.149:52634) 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.293+0000 7efc7fe00640 1 -- 172.21.15.149:0/1717045814 learned_addr learned my addr 172.21.15.149:0/1717045814 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc84c00640 1 --2- 172.21.15.149:0/1717045814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c230 0x7efc8006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc85600640 1 --2- 172.21.15.149:0/1717045814 >> v2:172.21.15.161:3300/0 conn(0x7efc80066cd0 0x7efc80067130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc7fe00640 1 -- 172.21.15.149:0/1717045814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c230 msgr2=0x7efc8006be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc7fe00640 1 --2- 172.21.15.149:0/1717045814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c230 0x7efc8006be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc7fe00640 1 -- 172.21.15.149:0/1717045814 >> v2:172.21.15.161:3300/0 conn(0x7efc80066cd0 msgr2=0x7efc80067130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.296 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc7fe00640 1 --2- 172.21.15.149:0/1717045814 >> v2:172.21.15.161:3300/0 conn(0x7efc80066cd0 0x7efc80067130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.296 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.294+0000 7efc7fe00640 1 -- 172.21.15.149:0/1717045814 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800ab060 con 0x7efc8015c600 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.295+0000 7efc7fe00640 1 --2- 172.21.15.149:0/1717045814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc8015c600 0x7efc8006e4e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc80069340 tx=0x7efc6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5719daa3e85c7f59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.295+0000 7efc7f400640 1 -- 172.21.15.149:0/1717045814 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c02add0 con 0x7efc8015c600 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.295+0000 7efc7f400640 1 -- 172.21.15.149:0/1717045814 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c032440 con 0x7efc8015c600 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.295+0000 7efc7f400640 1 -- 172.21.15.149:0/1717045814 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c032820 con 0x7efc8015c600 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 -- 172.21.15.149:0/1717045814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc8015c600 msgr2=0x7efc8006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 --2- 172.21.15.149:0/1717045814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc8015c600 0x7efc8006e4e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc80069340 tx=0x7efc6c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 -- 172.21.15.149:0/1717045814 shutdown_connections 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 --2- 172.21.15.149:0/1717045814 >> v2:172.21.15.161:3300/0 conn(0x7efc80066cd0 0x7efc80067130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 --2- 172.21.15.149:0/1717045814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc8015c600 0x7efc8006e4e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 --2- 172.21.15.149:0/1717045814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c230 0x7efc8006be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 -- 172.21.15.149:0/1717045814 >> 172.21.15.149:0/1717045814 conn(0x7efc8006d8f0 msgr2=0x7efc8006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 -- 172.21.15.149:0/1717045814 shutdown_connections 2024-08-17T02:47:12.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.296+0000 7efc87600640 1 -- 172.21.15.149:0/1717045814 wait complete. 2024-08-17T02:47:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.297+0000 7efc87600640 1 Processor -- start 2024-08-17T02:47:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.297+0000 7efc87600640 1 -- start start 2024-08-17T02:47:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc87600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 0x7efc80157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc87600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc8015c230 0x7efc800cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc87600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c600 0x7efc800ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc87600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c94c0 con 0x7efc80066cd0 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc87600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c97a0 con 0x7efc8015c230 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc87600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c9a80 con 0x7efc8015c600 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc84c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 0x7efc80157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc84c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 0x7efc80157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52636/0 (socket says 172.21.15.149:52636) 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc84c00640 1 -- 172.21.15.149:0/2050953990 learned_addr learned my addr 172.21.15.149:0/2050953990 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc7fe00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc8015c230 0x7efc800cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.298+0000 7efc85600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c600 0x7efc800ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc84c00640 1 -- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c600 msgr2=0x7efc800ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc84c00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c600 0x7efc800ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc84c00640 1 -- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc8015c230 msgr2=0x7efc800cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc84c00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc8015c230 0x7efc800cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc84c00640 1 -- 172.21.15.149:0/2050953990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009450 con 0x7efc80066cd0 2024-08-17T02:47:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc84c00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 0x7efc80157850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc7400ea20 tx=0x7efc740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400ca10 con 0x7efc80066cd0 2024-08-17T02:47:12.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7400cb70 con 0x7efc80066cd0 2024-08-17T02:47:12.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74013470 con 0x7efc80066cd0 2024-08-17T02:47:12.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.299+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800c9d60 con 0x7efc80066cd0 2024-08-17T02:47:12.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.300+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800cc180 con 0x7efc80066cd0 2024-08-17T02:47:12.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.301+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80064db0 con 0x7efc80066cd0 2024-08-17T02:47:12.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.302+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc74013860 con 0x7efc80066cd0 2024-08-17T02:47:12.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.302+0000 7efc73e00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efc60065150 0x7efc60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.302+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc74082690 con 0x7efc80066cd0 2024-08-17T02:47:12.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.303+0000 7efc7fe00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efc60065150 0x7efc60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.303+0000 7efc7fe00640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efc60065150 0x7efc60067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc6c034000 tx=0x7efc6c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.306+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc74050800 con 0x7efc80066cd0 2024-08-17T02:47:12.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.514+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc8006c230 con 0x7efc80066cd0 2024-08-17T02:47:12.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.514+0000 7efc73e00640 1 -- 172.21.15.149:0/2050953990 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc74053e20 con 0x7efc80066cd0 2024-08-17T02:47:12.515 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:12.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efc60065150 msgr2=0x7efc60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efc60065150 0x7efc60067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc6c034000 tx=0x7efc6c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 msgr2=0x7efc80157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 0x7efc80157850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc7400ea20 tx=0x7efc740090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 shutdown_connections 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efc60065150 0x7efc60067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc8015c600 0x7efc800ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc8015c230 0x7efc800cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 --2- 172.21.15.149:0/2050953990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc80066cd0 0x7efc80157850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 >> 172.21.15.149:0/2050953990 conn(0x7efc8006d8f0 msgr2=0x7efc80069840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 shutdown_connections 2024-08-17T02:47:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:12.517+0000 7efc87600640 1 -- 172.21.15.149:0/2050953990 wait complete. 2024-08-17T02:47:12.533 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:12.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:12.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-08-17T02:47:12.533 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:47:12.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:12.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:12.534 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:12.534 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:12.534 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:47:12.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.534 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:12.572 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42631sec preferred_lft 42631sec 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-08-17T02:47:12.573 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 42:4a:7c:07:4a:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::106a:e1ff:fea6:bef0/64 scope link 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 42:4a:7c:07:4a:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::404a:7cff:fe07:4a03/64 scope link tentative 2024-08-17T02:47:12.574 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:12.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.575 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:12.667 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-08-17T02:47:12.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.670 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-08-17T02:47:12.706 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-08-17T02:47:12.706 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:12.706 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:12.706 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:12.706 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:12.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.707 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:12.707 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:12.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:12.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:12.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:12.707 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:12.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.853 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:47:12.889 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:47:12.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.889 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-08-17T02:47:12.965 INFO:teuthology.orchestra.run.smithi161.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:47:12.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:12.965 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:12.965 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:12.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:47:12.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:47:12.966 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:13.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:13.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:47:13.149 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:13.149 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:13.149 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:13.149 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:a4:21:6d:8b:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::44a4:21ff:fe6d:8b18/64 scope link 2024-08-17T02:47:13.150 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:13.152 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:47:13.208 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:13.208 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:13.208 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:a4:21:6d:8b:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::44a4:21ff:fe6d:8b18/64 scope link 2024-08-17T02:47:13.209 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:13.211 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:47:13.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:13.211 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:13.211 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:13.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:47:13.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:13.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:47:13.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:47:13.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:47:13.212 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:13.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:13.377 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:13.377 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:13.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.1 up 2024-08-17T02:47:13.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:47:13.377 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:13.492 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:13.527 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:47:13.527 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:13.528 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:13.602 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:47:13.602 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:13.602 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:13.725 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:13.725 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:13.752 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:13.752 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:13.752 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-08-17T02:47:13.752 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 3@b8d2e793-20e6-428a-8b1c-2d641058b12a.cephfs=/ 2024-08-17T02:47:13.752 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.149:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-08-17T02:47:13.753 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:47:13.753 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:13.753 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:13.753 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:13.753 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:13.756 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:13.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:13.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:13.812 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:47:13.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:13.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.986+0000 7f6e79200640 1 Processor -- start 2024-08-17T02:47:13.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.987+0000 7f6e79200640 1 -- start start 2024-08-17T02:47:13.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e79200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e741401b0 0x7f6e740caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e79200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e74140580 0x7f6e740b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e79200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e740b16d0 con 0x7f6e740b1270 2024-08-17T02:47:13.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e79200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e740cb450 con 0x7f6e74140580 2024-08-17T02:47:13.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e79200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740caa80 con 0x7f6e741401b0 2024-08-17T02:47:13.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e72800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6e740b1270 0x7f6e740c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35262/0 (socket says 172.21.15.149:35262) 2024-08-17T02:47:13.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e72800640 1 -- 172.21.15.149:0/737850027 learned_addr learned my addr 172.21.15.149:0/737850027 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.988+0000 7f6e71e00640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e741401b0 0x7f6e740caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e71400640 1 --2- 172.21.15.149:0/737850027 >> v2:172.21.15.161:3300/0 conn(0x7f6e74140580 0x7f6e740b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e70a00640 1 -- 172.21.15.149:0/737850027 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999046524 0 0) 0x7f6e6c001490 con 0x7f6e740b1270 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e70a00640 1 -- 172.21.15.149:0/737850027 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e580034e0 con 0x7f6e740b1270 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e70a00640 1 -- 172.21.15.149:0/737850027 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303182584 0 0) 0x7f6e580034e0 con 0x7f6e740b1270 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e71400640 1 -- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e741401b0 msgr2=0x7f6e740caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e71400640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e741401b0 0x7f6e740caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e71400640 1 -- 172.21.15.149:0/737850027 >> v1:172.21.15.149:6789/0 conn(0x7f6e740b1270 legacy=0x7f6e740c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e71400640 1 -- 172.21.15.149:0/737850027 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740c9e70 con 0x7f6e74140580 2024-08-17T02:47:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.989+0000 7f6e71e00640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e741401b0 0x7f6e740caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.990+0000 7f6e71400640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e74140580 0x7f6e740b0d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009850 tx=0x7f6e600090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9990d703821e3b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.990+0000 7f6e70a00640 1 -- 172.21.15.149:0/737850027 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c001980 con 0x7f6e74140580 2024-08-17T02:47:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.990+0000 7f6e70a00640 1 -- 172.21.15.149:0/737850027 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6002a9c0 con 0x7f6e74140580 2024-08-17T02:47:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.990+0000 7f6e70a00640 1 -- 172.21.15.149:0/737850027 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6002ad60 con 0x7f6e74140580 2024-08-17T02:47:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 -- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e74140580 msgr2=0x7f6e740b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e74140580 0x7f6e740b0d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009850 tx=0x7f6e600090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 -- 172.21.15.149:0/737850027 shutdown_connections 2024-08-17T02:47:13.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e74140580 0x7f6e740b0d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 --2- 172.21.15.149:0/737850027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e741401b0 0x7f6e740caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 -- 172.21.15.149:0/737850027 >> 172.21.15.149:0/737850027 conn(0x7f6e740cb9b0 msgr2=0x7f6e740cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 -- 172.21.15.149:0/737850027 shutdown_connections 2024-08-17T02:47:13.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.991+0000 7f6e79200640 1 -- 172.21.15.149:0/737850027 wait complete. 2024-08-17T02:47:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.993+0000 7f6e79200640 1 Processor -- start 2024-08-17T02:47:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.993+0000 7f6e79200640 1 -- start start 2024-08-17T02:47:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.993+0000 7f6e79200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 0x7f6e7415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.993+0000 7f6e79200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e741401b0 0x7f6e740c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e79200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e74140580 0x7f6e740aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e79200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740abab0 con 0x7f6e740b1270 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e79200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74168e10 con 0x7f6e741401b0 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e79200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740ab210 con 0x7f6e74140580 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 0x7f6e7415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 0x7f6e7415b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52642/0 (socket says 172.21.15.149:52642) 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 -- 172.21.15.149:0/1872043800 learned_addr learned my addr 172.21.15.149:0/1872043800 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71400640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e741401b0 0x7f6e740c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e72800640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e74140580 0x7f6e740aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 -- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e74140580 msgr2=0x7f6e740aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e74140580 0x7f6e740aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 -- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e741401b0 msgr2=0x7f6e740c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e741401b0 0x7f6e740c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 -- 172.21.15.149:0/1872043800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e64009390 con 0x7f6e740b1270 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.994+0000 7f6e71e00640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 0x7f6e7415b830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400ea70 tx=0x7f6e640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.995+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400ca10 con 0x7f6e740b1270 2024-08-17T02:47:13.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.995+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6400cb70 con 0x7f6e740b1270 2024-08-17T02:47:13.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.995+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64013470 con 0x7f6e740b1270 2024-08-17T02:47:13.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.995+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e60009390 con 0x7f6e740b1270 2024-08-17T02:47:13.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.995+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e74169020 con 0x7f6e740b1270 2024-08-17T02:47:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.996+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e74064db0 con 0x7f6e740b1270 2024-08-17T02:47:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.997+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6e64013820 con 0x7f6e740b1270 2024-08-17T02:47:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.997+0000 7f6e69600640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e54065150 0x7f6e54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.998+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e64082710 con 0x7f6e740b1270 2024-08-17T02:47:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.998+0000 7f6e71400640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e54065150 0x7f6e54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:13.998+0000 7f6e71400640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e54065150 0x7f6e54067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e60034000 tx=0x7f6e60032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.002+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6e64050880 con 0x7f6e740b1270 2024-08-17T02:47:14.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.176+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e7406d350 con 0x7f6e740b1270 2024-08-17T02:47:14.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.177+0000 7f6e69600640 1 -- 172.21.15.149:0/1872043800 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6e64053ea0 con 0x7f6e740b1270 2024-08-17T02:47:14.178 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:14.178 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:14.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e54065150 msgr2=0x7f6e54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e54065150 0x7f6e54067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e60034000 tx=0x7f6e60032000 comp rx=0 tx=0).stop 2024-08-17T02:47:14.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 msgr2=0x7f6e7415b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 0x7f6e7415b830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400ea70 tx=0x7f6e640090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 shutdown_connections 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e54065150 0x7f6e54067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e74140580 0x7f6e740aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e741401b0 0x7f6e740c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 --2- 172.21.15.149:0/1872043800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e740b1270 0x7f6e7415b830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 >> 172.21.15.149:0/1872043800 conn(0x7f6e740cb9b0 msgr2=0x7f6e7406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.179+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 shutdown_connections 2024-08-17T02:47:14.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.180+0000 7f6e79200640 1 -- 172.21.15.149:0/1872043800 wait complete. 2024-08-17T02:47:14.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:14.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:14.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.349+0000 7f9156400640 1 Processor -- start 2024-08-17T02:47:14.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.349+0000 7f9156400640 1 -- start start 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9156400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f91500cc8d0 0x7f91500ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9156400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f91500ce5c0 0x7f91500b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9156400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91500ceeb0 con 0x7f9150158e50 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9156400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91500cf190 con 0x7f91500ce5c0 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9156400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91500cf470 con 0x7f91500cc8d0 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9155000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9150158e50 0x7f91500cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35274/0 (socket says 172.21.15.149:35274) 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.350+0000 7f9155000640 1 -- 172.21.15.149:0/111083353 learned_addr learned my addr 172.21.15.149:0/111083353 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f9155a00640 1 --2- 172.21.15.149:0/111083353 >> v2:172.21.15.149:3300/0 conn(0x7f91500ce5c0 0x7f91500b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f914fe00640 1 --2- 172.21.15.149:0/111083353 >> v2:172.21.15.161:3300/0 conn(0x7f91500cc8d0 0x7f91500ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f914f400640 1 -- 172.21.15.149:0/111083353 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030167436 0 0) 0x7f91500ceeb0 con 0x7f9150158e50 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f914f400640 1 -- 172.21.15.149:0/111083353 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91380034e0 con 0x7f9150158e50 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f9155a00640 1 -- 172.21.15.149:0/111083353 >> v2:172.21.15.161:3300/0 conn(0x7f91500cc8d0 msgr2=0x7f91500ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f9155a00640 1 --2- 172.21.15.149:0/111083353 >> v2:172.21.15.161:3300/0 conn(0x7f91500cc8d0 0x7f91500ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f9155a00640 1 -- 172.21.15.149:0/111083353 >> v1:172.21.15.149:6789/0 conn(0x7f9150158e50 legacy=0x7f91500cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f9155a00640 1 -- 172.21.15.149:0/111083353 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500b2a00 con 0x7f91500ce5c0 2024-08-17T02:47:14.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.351+0000 7f914fe00640 1 --2- 172.21.15.149:0/111083353 >> v2:172.21.15.161:3300/0 conn(0x7f91500cc8d0 0x7f91500ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:14.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.352+0000 7f9155a00640 1 --2- 172.21.15.149:0/111083353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500b3200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9150069420 tx=0x7f9148009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aab1468a0e6b2e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.352+0000 7f914f400640 1 -- 172.21.15.149:0/111083353 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148007550 con 0x7f91500ce5c0 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.352+0000 7f914f400640 1 -- 172.21.15.149:0/111083353 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914802d050 con 0x7f91500ce5c0 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.352+0000 7f914f400640 1 -- 172.21.15.149:0/111083353 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148007920 con 0x7f91500ce5c0 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 -- 172.21.15.149:0/111083353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 msgr2=0x7f91500b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 --2- 172.21.15.149:0/111083353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500b3200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9150069420 tx=0x7f9148009780 comp rx=0 tx=0).stop 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 -- 172.21.15.149:0/111083353 shutdown_connections 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 --2- 172.21.15.149:0/111083353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500b3200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 --2- 172.21.15.149:0/111083353 >> v2:172.21.15.161:3300/0 conn(0x7f91500cc8d0 0x7f91500ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 -- 172.21.15.149:0/111083353 >> 172.21.15.149:0/111083353 conn(0x7f9150098de0 msgr2=0x7f915006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 -- 172.21.15.149:0/111083353 shutdown_connections 2024-08-17T02:47:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.353+0000 7f9156400640 1 -- 172.21.15.149:0/111083353 wait complete. 2024-08-17T02:47:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.354+0000 7f9156400640 1 Processor -- start 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.355+0000 7f9156400640 1 -- start start 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.355+0000 7f9156400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91500cc8d0 0x7f91501681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.355+0000 7f9156400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f9156400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9150158e50 0x7f91500c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f9156400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9150168720 con 0x7f91500ce5c0 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f9156400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915015b3f0 con 0x7f91500cc8d0 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f9156400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915015b6d0 con 0x7f9150158e50 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52670/0 (socket says 172.21.15.149:52670) 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f9155000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91500cc8d0 0x7f91501681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 -- 172.21.15.149:0/1218747572 learned_addr learned my addr 172.21.15.149:0/1218747572 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f9155a00640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9150158e50 0x7f91500c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 -- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9150158e50 msgr2=0x7f91500c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9150158e50 0x7f91500c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 -- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91500cc8d0 msgr2=0x7f91501681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91500cc8d0 0x7f91501681e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.356+0000 7f914fe00640 1 -- 172.21.15.149:0/1218747572 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148009a20 con 0x7f91500ce5c0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.357+0000 7f914fe00640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500c9220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f913c00d890 tx=0x7f913c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.357+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00de80 con 0x7f91500ce5c0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.357+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00b8d0 con 0x7f91500ce5c0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.357+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00bc90 con 0x7f91500ce5c0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.357+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915015b9b0 con 0x7f91500ce5c0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.357+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91500c4350 con 0x7f91500ce5c0 2024-08-17T02:47:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.358+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9150071050 con 0x7f91500ce5c0 2024-08-17T02:47:14.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.359+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f913c01e460 con 0x7f91500ce5c0 2024-08-17T02:47:14.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.359+0000 7f9143e00640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9130065180 0x7f9130067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.360+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f913c082a30 con 0x7f91500ce5c0 2024-08-17T02:47:14.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.360+0000 7f9155000640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9130065180 0x7f9130067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.360+0000 7f9155000640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9130065180 0x7f9130067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9144005840 tx=0x7f9144009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.364+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f913c050b00 con 0x7f91500ce5c0 2024-08-17T02:47:14.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.534+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9150064610 con 0x7f91500ce5c0 2024-08-17T02:47:14.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.535+0000 7f9143e00640 1 -- 172.21.15.149:0/1218747572 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f913c054120 con 0x7f91500ce5c0 2024-08-17T02:47:14.536 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9130065180 msgr2=0x7f9130067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9130065180 0x7f9130067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9144005840 tx=0x7f9144009040 comp rx=0 tx=0).stop 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 msgr2=0x7f91500c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500c9220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f913c00d890 tx=0x7f913c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 shutdown_connections 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9130065180 0x7f9130067630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9150158e50 0x7f91500c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91500ce5c0 0x7f91500c9220 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 --2- 172.21.15.149:0/1218747572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91500cc8d0 0x7f91501681e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 >> 172.21.15.149:0/1218747572 conn(0x7f9150098de0 msgr2=0x7f915015e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 shutdown_connections 2024-08-17T02:47:14.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.537+0000 7f9156400640 1 -- 172.21.15.149:0/1218747572 wait complete. 2024-08-17T02:47:14.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.705+0000 7f61d5800640 1 Processor -- start 2024-08-17T02:47:14.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.705+0000 7f61d5800640 1 -- start start 2024-08-17T02:47:14.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.706+0000 7f61d5800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61d0155a80 0x7f61d006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.706+0000 7f61d5800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f61d00c92e0 0x7f61d00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.706+0000 7f61d5800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d01598f0 con 0x7f61d00c7db0 2024-08-17T02:47:14.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.706+0000 7f61d5800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d0159bd0 con 0x7f61d00c92e0 2024-08-17T02:47:14.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.706+0000 7f61d5800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d0159eb0 con 0x7f61d0155a80 2024-08-17T02:47:14.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f61d00c92e0 0x7f61d00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f61d00c92e0 0x7f61d00aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52686/0 (socket says 172.21.15.149:52686) 2024-08-17T02:47:14.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 -- 172.21.15.149:0/1452207503 learned_addr learned my addr 172.21.15.149:0/1452207503 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:14.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61ce000640 1 --1- 172.21.15.149:0/1452207503 >> v1:172.21.15.149:6789/0 conn(0x7f61d00c7db0 0x7f61d00c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35286/0 (socket says 172.21.15.149:35286) 2024-08-17T02:47:14.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cea00640 1 --2- 172.21.15.149:0/1452207503 >> v2:172.21.15.161:3300/0 conn(0x7f61d0155a80 0x7f61d006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 -- 172.21.15.149:0/1452207503 >> v2:172.21.15.161:3300/0 conn(0x7f61d0155a80 msgr2=0x7f61d006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 --2- 172.21.15.149:0/1452207503 >> v2:172.21.15.161:3300/0 conn(0x7f61d0155a80 0x7f61d006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 -- 172.21.15.149:0/1452207503 >> v1:172.21.15.149:6789/0 conn(0x7f61d00c7db0 legacy=0x7f61d00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.707+0000 7f61cf400640 1 -- 172.21.15.149:0/1452207503 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d015a190 con 0x7f61d00c92e0 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.708+0000 7f61cf400640 1 --2- 172.21.15.149:0/1452207503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c92e0 0x7f61d00aea40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61d006efd0 tx=0x7f61c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756fb18d1a263a76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.708+0000 7f61cd600640 1 -- 172.21.15.149:0/1452207503 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8032480 con 0x7f61d00c92e0 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.708+0000 7f61cd600640 1 -- 172.21.15.149:0/1452207503 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80325e0 con 0x7f61d00c92e0 2024-08-17T02:47:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.708+0000 7f61cd600640 1 -- 172.21.15.149:0/1452207503 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80329c0 con 0x7f61d00c92e0 2024-08-17T02:47:14.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 -- 172.21.15.149:0/1452207503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c92e0 msgr2=0x7f61d00aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 --2- 172.21.15.149:0/1452207503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c92e0 0x7f61d00aea40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61d006efd0 tx=0x7f61c8009840 comp rx=0 tx=0).stop 2024-08-17T02:47:14.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 -- 172.21.15.149:0/1452207503 shutdown_connections 2024-08-17T02:47:14.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 --2- 172.21.15.149:0/1452207503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c92e0 0x7f61d00aea40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 --2- 172.21.15.149:0/1452207503 >> v2:172.21.15.161:3300/0 conn(0x7f61d0155a80 0x7f61d006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 -- 172.21.15.149:0/1452207503 >> 172.21.15.149:0/1452207503 conn(0x7f61d0067750 msgr2=0x7f61d00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 -- 172.21.15.149:0/1452207503 shutdown_connections 2024-08-17T02:47:14.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.709+0000 7f61d5800640 1 -- 172.21.15.149:0/1452207503 wait complete. 2024-08-17T02:47:14.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.710+0000 7f61d5800640 1 Processor -- start 2024-08-17T02:47:14.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.710+0000 7f61d5800640 1 -- start start 2024-08-17T02:47:14.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.711+0000 7f61d5800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 0x7f61d013cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.711+0000 7f61d5800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d00c92e0 0x7f61d00ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.711+0000 7f61d5800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0155a80 0x7f61d00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.711+0000 7f61d5800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01568b0 con 0x7f61d00c7db0 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.711+0000 7f61d5800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d016db40 con 0x7f61d00c92e0 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.711+0000 7f61d5800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0155f80 con 0x7f61d0155a80 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 0x7f61d013cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 0x7f61d013cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52696/0 (socket says 172.21.15.149:52696) 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 -- 172.21.15.149:0/3526826273 learned_addr learned my addr 172.21.15.149:0/3526826273 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61ce000640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d00c92e0 0x7f61d00ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cf400640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0155a80 0x7f61d00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 -- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0155a80 msgr2=0x7f61d00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0155a80 0x7f61d00ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 -- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d00c92e0 msgr2=0x7f61d00ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d00c92e0 0x7f61d00ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 -- 172.21.15.149:0/3526826273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009ae0 con 0x7f61d00c7db0 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.712+0000 7f61cea00640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 0x7f61d013cee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e900 tx=0x7f61c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.713+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000c8e0 con 0x7f61d00c7db0 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.713+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000ca40 con 0x7f61d00c7db0 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.713+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000cde0 con 0x7f61d00c7db0 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.713+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0156260 con 0x7f61d00c7db0 2024-08-17T02:47:14.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.713+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d013d420 con 0x7f61d00c7db0 2024-08-17T02:47:14.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.714+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d0071050 con 0x7f61d00c7db0 2024-08-17T02:47:14.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.715+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f61c0013680 con 0x7f61d00c7db0 2024-08-17T02:47:14.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.715+0000 7f61c6000640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61b0065150 0x7f61b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.715+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61c00825c0 con 0x7f61d00c7db0 2024-08-17T02:47:14.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.716+0000 7f61ce000640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61b0065150 0x7f61b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.716+0000 7f61ce000640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61b0065150 0x7f61b0067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61d0143e80 tx=0x7f61bc007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.719+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61c0050690 con 0x7f61d00c7db0 2024-08-17T02:47:14.894 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.893+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61d00633c0 con 0x7f61d00c7db0 2024-08-17T02:47:14.894 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.894+0000 7f61c6000640 1 -- 172.21.15.149:0/3526826273 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61c0080e60 con 0x7f61d00c7db0 2024-08-17T02:47:14.895 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61b0065150 msgr2=0x7f61b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61b0065150 0x7f61b0067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61d0143e80 tx=0x7f61bc007e20 comp rx=0 tx=0).stop 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 msgr2=0x7f61d013cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 0x7f61d013cee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e900 tx=0x7f61c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 shutdown_connections 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f61b0065150 0x7f61b0067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0155a80 0x7f61d00ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d00c92e0 0x7f61d00ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 --2- 172.21.15.149:0/3526826273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61d00c7db0 0x7f61d013cee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 >> 172.21.15.149:0/3526826273 conn(0x7f61d0067750 msgr2=0x7f61d00ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 shutdown_connections 2024-08-17T02:47:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:14.896+0000 7f61d5800640 1 -- 172.21.15.149:0/3526826273 wait complete. 2024-08-17T02:47:14.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:15.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.063+0000 7f75aa600640 1 Processor -- start 2024-08-17T02:47:15.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.063+0000 7f75aa600640 1 -- start start 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.064+0000 7f75aa600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f75a40adcf0 0x7f75a40ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.064+0000 7f75aa600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f75a40abb00 0x7f75a40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.064+0000 7f75aa600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a40ab130 con 0x7f75a4156c50 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.064+0000 7f75aa600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40ae5a0 con 0x7f75a40adcf0 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.064+0000 7f75aa600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40ae2c0 con 0x7f75a40abb00 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f75a40adcf0 0x7f75a40ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f75a40adcf0 0x7f75a40ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52700/0 (socket says 172.21.15.149:52700) 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 -- 172.21.15.149:0/2713242958 learned_addr learned my addr 172.21.15.149:0/2713242958 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a3e00640 1 --2- 172.21.15.149:0/2713242958 >> v2:172.21.15.161:3300/0 conn(0x7f75a40abb00 0x7f75a40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 -- 172.21.15.149:0/2713242958 >> v2:172.21.15.161:3300/0 conn(0x7f75a40abb00 msgr2=0x7f75a40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:15.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 --2- 172.21.15.149:0/2713242958 >> v2:172.21.15.161:3300/0 conn(0x7f75a40abb00 0x7f75a40c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 -- 172.21.15.149:0/2713242958 >> v1:172.21.15.161:6789/0 conn(0x7f75a4156c50 legacy=0x7f75a40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:15.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.065+0000 7f75a2a00640 1 -- 172.21.15.149:0/2713242958 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40aaae0 con 0x7f75a40adcf0 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.066+0000 7f75a2a00640 1 --2- 172.21.15.149:0/2713242958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40adcf0 0x7f75a40ab5c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75a4070660 tx=0x7f758c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158955f300ae88fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.066+0000 7f75a2000640 1 -- 172.21.15.149:0/2713242958 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c02acc0 con 0x7f75a40adcf0 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75a2000640 1 -- 172.21.15.149:0/2713242958 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c02ae20 con 0x7f75a40adcf0 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75a2000640 1 -- 172.21.15.149:0/2713242958 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c032670 con 0x7f75a40adcf0 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 -- 172.21.15.149:0/2713242958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40adcf0 msgr2=0x7f75a40ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 --2- 172.21.15.149:0/2713242958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40adcf0 0x7f75a40ab5c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75a4070660 tx=0x7f758c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 -- 172.21.15.149:0/2713242958 shutdown_connections 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 --2- 172.21.15.149:0/2713242958 >> v2:172.21.15.161:3300/0 conn(0x7f75a40abb00 0x7f75a40c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 --2- 172.21.15.149:0/2713242958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40adcf0 0x7f75a40ab5c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 -- 172.21.15.149:0/2713242958 >> 172.21.15.149:0/2713242958 conn(0x7f75a4067750 msgr2=0x7f75a40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 -- 172.21.15.149:0/2713242958 shutdown_connections 2024-08-17T02:47:15.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.067+0000 7f75aa600640 1 -- 172.21.15.149:0/2713242958 wait complete. 2024-08-17T02:47:15.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.069+0000 7f75aa600640 1 Processor -- start 2024-08-17T02:47:15.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.069+0000 7f75aa600640 1 -- start start 2024-08-17T02:47:15.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75aa600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 0x7f75a4142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75aa600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75a40adcf0 0x7f75a415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75aa600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75a4156c50 0x7f75a4155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75aa600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41549c0 con 0x7f75a40abb00 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75aa600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4154ca0 con 0x7f75a40adcf0 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75aa600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41575a0 con 0x7f75a4156c50 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 0x7f75a4142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 0x7f75a4142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52708/0 (socket says 172.21.15.149:52708) 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 -- 172.21.15.149:0/2590249775 learned_addr learned my addr 172.21.15.149:0/2590249775 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a2a00640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75a40adcf0 0x7f75a415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3e00640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75a4156c50 0x7f75a4155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 -- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75a4156c50 msgr2=0x7f75a4155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75a4156c50 0x7f75a4155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 -- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75a40adcf0 msgr2=0x7f75a415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75a40adcf0 0x7f75a415a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.070+0000 7f75a3400640 1 -- 172.21.15.149:0/2590249775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009450 con 0x7f75a40abb00 2024-08-17T02:47:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.071+0000 7f75a3400640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 0x7f75a4142260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f759400bc60 tx=0x7f7594009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.071+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400ca70 con 0x7f75a40abb00 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.071+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400cbd0 con 0x7f75a40abb00 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.071+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a4157880 con 0x7f75a40abb00 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.071+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594014410 con 0x7f75a40abb00 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.071+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a41427a0 con 0x7f75a40abb00 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.072+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4071050 con 0x7f75a40abb00 2024-08-17T02:47:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.073+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7594014840 con 0x7f75a40abb00 2024-08-17T02:47:15.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.074+0000 7f759aa00640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7580065150 0x7f7580067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.074+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7594082560 con 0x7f75a40abb00 2024-08-17T02:47:15.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.074+0000 7f75a2a00640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7580065150 0x7f7580067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.074+0000 7f75a2a00640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7580065150 0x7f7580067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.077+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f759404ce40 con 0x7f75a40abb00 2024-08-17T02:47:15.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.250+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75a40ca790 con 0x7f75a40abb00 2024-08-17T02:47:15.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.250+0000 7f759aa00640 1 -- 172.21.15.149:0/2590249775 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7594050630 con 0x7f75a40abb00 2024-08-17T02:47:15.251 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.252+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7580065150 msgr2=0x7f7580067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.252+0000 7f75aa600640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7580065150 0x7f7580067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.252+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 msgr2=0x7f75a4142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.252+0000 7f75aa600640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 0x7f75a4142260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f759400bc60 tx=0x7f7594009820 comp rx=0 tx=0).stop 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 shutdown_connections 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7580065150 0x7f7580067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75a4156c50 0x7f75a4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75a40adcf0 0x7f75a415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 --2- 172.21.15.149:0/2590249775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a40abb00 0x7f75a4142260 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 >> 172.21.15.149:0/2590249775 conn(0x7f75a4067750 msgr2=0x7f75a41533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 shutdown_connections 2024-08-17T02:47:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.253+0000 7f75aa600640 1 -- 172.21.15.149:0/2590249775 wait complete. 2024-08-17T02:47:15.268 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.415+0000 7ff9b1800640 1 Processor -- start 2024-08-17T02:47:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.415+0000 7ff9b1800640 1 -- start start 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9b1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff9ac0b1440 0x7ff9ac0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9b1800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0caa80 con 0x7ff9ac140580 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9b1800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0c9e70 con 0x7ff9ac1401b0 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9b1800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0cb450 con 0x7ff9ac0b1440 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9aa000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff9ac0b1440 0x7ff9ac0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9ab400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff9ac140580 0x7ff9ac0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35288/0 (socket says 172.21.15.149:35288) 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.416+0000 7ff9ab400640 1 -- 172.21.15.149:0/3920275968 learned_addr learned my addr 172.21.15.149:0/3920275968 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:15.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.417+0000 7ff9aa000640 1 -- 172.21.15.149:0/3920275968 >> v1:172.21.15.161:6789/0 conn(0x7ff9ac1401b0 legacy=0x7ff9ac0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:15.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.417+0000 7ff9aa000640 1 -- 172.21.15.149:0/3920275968 >> v1:172.21.15.149:6789/0 conn(0x7ff9ac140580 legacy=0x7ff9ac0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.417+0000 7ff9aa000640 1 -- 172.21.15.149:0/3920275968 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0ca150 con 0x7ff9ac0b1440 2024-08-17T02:47:15.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.417+0000 7ff9a9600640 1 -- 172.21.15.149:0/3920275968 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526341519 0 0) 0x7ff9ac0caa80 con 0x7ff9ac140580 2024-08-17T02:47:15.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.418+0000 7ff9aa000640 1 --2- 172.21.15.149:0/3920275968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac0b1440 0x7ff9ac0caf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff998009850 tx=0x7ff9980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5200b9b4933e6663 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.418+0000 7ff9a9600640 1 -- 172.21.15.149:0/3920275968 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99802adb0 con 0x7ff9ac0b1440 2024-08-17T02:47:15.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.418+0000 7ff9a9600640 1 -- 172.21.15.149:0/3920275968 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998032440 con 0x7ff9ac0b1440 2024-08-17T02:47:15.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.418+0000 7ff9a9600640 1 -- 172.21.15.149:0/3920275968 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980327e0 con 0x7ff9ac0b1440 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 -- 172.21.15.149:0/3920275968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac0b1440 msgr2=0x7ff9ac0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3920275968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac0b1440 0x7ff9ac0caf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff998009850 tx=0x7ff9980090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 -- 172.21.15.149:0/3920275968 shutdown_connections 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3920275968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac0b1440 0x7ff9ac0caf10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 -- 172.21.15.149:0/3920275968 >> 172.21.15.149:0/3920275968 conn(0x7ff9ac0cb9b0 msgr2=0x7ff9ac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 -- 172.21.15.149:0/3920275968 shutdown_connections 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.419+0000 7ff9b1800640 1 -- 172.21.15.149:0/3920275968 wait complete. 2024-08-17T02:47:15.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.420+0000 7ff9b1800640 1 Processor -- start 2024-08-17T02:47:15.421 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.420+0000 7ff9b1800640 1 -- start start 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9b1800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9ac0b1440 0x7ff9ac0a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9b1800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9ac1401b0 0x7ff9ac16abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9b1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 0x7ff9ac13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9b1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0a9390 con 0x7ff9ac140580 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9b1800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0a9670 con 0x7ff9ac1401b0 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9b1800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0a9950 con 0x7ff9ac0b1440 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9ab400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 0x7ff9ac13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9ab400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 0x7ff9ac13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52716/0 (socket says 172.21.15.149:52716) 2024-08-17T02:47:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.421+0000 7ff9ab400640 1 -- 172.21.15.149:0/3971219518 learned_addr learned my addr 172.21.15.149:0/3971219518 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9aa000640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9ac1401b0 0x7ff9ac16abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9aaa00640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9ac0b1440 0x7ff9ac0a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9ab400640 1 -- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9ac0b1440 msgr2=0x7ff9ac0a8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9ab400640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9ac0b1440 0x7ff9ac0a8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9ab400640 1 -- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9ac1401b0 msgr2=0x7ff9ac16abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9ab400640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9ac1401b0 0x7ff9ac16abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9ab400640 1 -- 172.21.15.149:0/3971219518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009390 con 0x7ff9ac140580 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9aaa00640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9ac0b1440 0x7ff9ac0a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9ab400640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 0x7ff9ac13bf40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400cc90 tx=0x7ff9a4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400a850 con 0x7ff9ac140580 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400a9b0 con 0x7ff9ac140580 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400ad70 con 0x7ff9ac140580 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0a9c30 con 0x7ff9ac140580 2024-08-17T02:47:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.422+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac0a9080 con 0x7ff9ac140580 2024-08-17T02:47:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.423+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac064db0 con 0x7ff9ac140580 2024-08-17T02:47:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.424+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9a4007300 con 0x7ff9ac140580 2024-08-17T02:47:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.425+0000 7ff9a2000640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff98c065150 0x7ff98c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.425+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9a40826a0 con 0x7ff9ac140580 2024-08-17T02:47:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.425+0000 7ff9aaa00640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff98c065150 0x7ff98c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.426+0000 7ff9aaa00640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff98c065150 0x7ff98c067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0027e0 tx=0x7ff99c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.429 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.429+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9a4050740 con 0x7ff9ac140580 2024-08-17T02:47:15.606 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.606+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9ac0add30 con 0x7ff9ac140580 2024-08-17T02:47:15.607 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.607+0000 7ff9a2000640 1 -- 172.21.15.149:0/3971219518 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff9a4053d60 con 0x7ff9ac140580 2024-08-17T02:47:15.607 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:15.608 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:15.609 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff98c065150 msgr2=0x7ff98c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff98c065150 0x7ff98c067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0027e0 tx=0x7ff99c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 msgr2=0x7ff9ac13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 0x7ff9ac13bf40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400cc90 tx=0x7ff9a4001a80 comp rx=0 tx=0).stop 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 shutdown_connections 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff98c065150 0x7ff98c067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9ac140580 0x7ff9ac13bf40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9ac1401b0 0x7ff9ac16abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 --2- 172.21.15.149:0/3971219518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9ac0b1440 0x7ff9ac0a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 >> 172.21.15.149:0/3971219518 conn(0x7ff9ac0cb9b0 msgr2=0x7ff9ac0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 shutdown_connections 2024-08-17T02:47:15.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.609+0000 7ff9b1800640 1 -- 172.21.15.149:0/3971219518 wait complete. 2024-08-17T02:47:15.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:15.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:15.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.777+0000 7f6439c00640 1 Processor -- start 2024-08-17T02:47:15.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.777+0000 7f6439c00640 1 -- start start 2024-08-17T02:47:15.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6439c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f64340b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6439c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6434159610 0x7f6434157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6439c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340ae540 con 0x7f64340accf0 2024-08-17T02:47:15.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6439c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340ad930 con 0x7f6434159610 2024-08-17T02:47:15.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6439c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340adc10 con 0x7f64340afd90 2024-08-17T02:47:15.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6432a00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f64340accf0 0x7f64340af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35296/0 (socket says 172.21.15.149:35296) 2024-08-17T02:47:15.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6432a00640 1 -- 172.21.15.149:0/3807029456 learned_addr learned my addr 172.21.15.149:0/3807029456 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6433400640 1 --2- 172.21.15.149:0/3807029456 >> v2:172.21.15.161:3300/0 conn(0x7f6434159610 0x7f6434157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6432000640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f64340b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.779+0000 7f6431600640 1 -- 172.21.15.149:0/3807029456 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867516801 0 0) 0x7f64340ae540 con 0x7f64340accf0 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.780+0000 7f6431600640 1 -- 172.21.15.149:0/3807029456 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64180034e0 con 0x7f64340accf0 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.780+0000 7f6433400640 1 -- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 msgr2=0x7f64340b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.780+0000 7f6433400640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f64340b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.780+0000 7f6433400640 1 -- 172.21.15.149:0/3807029456 >> v1:172.21.15.149:6789/0 conn(0x7f64340accf0 legacy=0x7f64340af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.780+0000 7f6433400640 1 -- 172.21.15.149:0/3807029456 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340adef0 con 0x7f6434159610 2024-08-17T02:47:15.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.780+0000 7f6432000640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f64340b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.781+0000 7f6433400640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f6434157690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f642c009e60 tx=0x7f642c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20de0a501f769023 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.781+0000 7f6431600640 1 -- 172.21.15.149:0/3807029456 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c007550 con 0x7f6434159610 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.781+0000 7f6431600640 1 -- 172.21.15.149:0/3807029456 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c02d050 con 0x7f6434159610 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.781+0000 7f6431600640 1 -- 172.21.15.149:0/3807029456 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c007900 con 0x7f6434159610 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 -- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 msgr2=0x7f6434157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f6434157690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f642c009e60 tx=0x7f642c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 -- 172.21.15.149:0/3807029456 shutdown_connections 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f6434157690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 --2- 172.21.15.149:0/3807029456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f64340b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 -- 172.21.15.149:0/3807029456 >> 172.21.15.149:0/3807029456 conn(0x7f6434067750 msgr2=0x7f64340cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 -- 172.21.15.149:0/3807029456 shutdown_connections 2024-08-17T02:47:15.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.782+0000 7f6439c00640 1 -- 172.21.15.149:0/3807029456 wait complete. 2024-08-17T02:47:15.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.783+0000 7f6439c00640 1 Processor -- start 2024-08-17T02:47:15.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.783+0000 7f6439c00640 1 -- start start 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.784+0000 7f6439c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 0x7f64340c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.784+0000 7f6439c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f6434141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.784+0000 7f6439c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f643415aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.784+0000 7f6439c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6434142150 con 0x7f64340accf0 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.784+0000 7f6439c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64341423d0 con 0x7f6434159610 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.784+0000 7f6439c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64341426b0 con 0x7f64340afd90 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 0x7f64340c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 0x7f64340c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52732/0 (socket says 172.21.15.149:52732) 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 -- 172.21.15.149:0/623849967 learned_addr learned my addr 172.21.15.149:0/623849967 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6433400640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f643415aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432000640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f6434141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 -- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 msgr2=0x7f6434141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f6434141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 -- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 msgr2=0x7f643415aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f643415aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 -- 172.21.15.149:0/623849967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420009390 con 0x7f64340accf0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6433400640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f643415aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f6432a00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 0x7f64340c0dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f642400c560 tx=0x7f6424007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424005aa0 con 0x7f64340accf0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.785+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424005c00 con 0x7f64340accf0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.786+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c009a20 con 0x7f64340accf0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.786+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240070d0 con 0x7f64340accf0 2024-08-17T02:47:15.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.786+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6434142c70 con 0x7f64340accf0 2024-08-17T02:47:15.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.787+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6434064db0 con 0x7f64340accf0 2024-08-17T02:47:15.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.787+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f64240074c0 con 0x7f64340accf0 2024-08-17T02:47:15.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.788+0000 7f642a000640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6414065150 0x7f6414067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.788+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64240819e0 con 0x7f64340accf0 2024-08-17T02:47:15.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.789+0000 7f6432000640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6414065150 0x7f6414067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.789+0000 7f6432000640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6414065150 0x7f6414067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6420009360 tx=0x7f6420008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.792+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f642404fa00 con 0x7f64340accf0 2024-08-17T02:47:15.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.964+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64340cb6d0 con 0x7f64340accf0 2024-08-17T02:47:15.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.965+0000 7f642a000640 1 -- 172.21.15.149:0/623849967 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6424017020 con 0x7f64340accf0 2024-08-17T02:47:15.966 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:15.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6414065150 msgr2=0x7f6414067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.967 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6414065150 0x7f6414067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6420009360 tx=0x7f6420008040 comp rx=0 tx=0).stop 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 msgr2=0x7f64340c0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 0x7f64340c0dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f642400c560 tx=0x7f6424007d60 comp rx=0 tx=0).stop 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 shutdown_connections 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6414065150 0x7f6414067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6434159610 0x7f643415aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64340afd90 0x7f6434141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 --2- 172.21.15.149:0/623849967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64340accf0 0x7f64340c0dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 >> 172.21.15.149:0/623849967 conn(0x7f6434067750 msgr2=0x7f6434158280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.968 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 shutdown_connections 2024-08-17T02:47:15.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:15.967+0000 7f6439c00640 1 -- 172.21.15.149:0/623849967 wait complete. 2024-08-17T02:47:15.983 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:16.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.134+0000 7f6123200640 1 Processor -- start 2024-08-17T02:47:16.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.134+0000 7f6123200640 1 -- start start 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6123200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61240ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6123200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6124155a30 0x7f612406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6123200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240afc40 con 0x7f6124155660 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6123200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61240af030 con 0x7f6124155a30 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6123200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61240af310 con 0x7f61240adfb0 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6121e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6124155660 0x7f61240c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:35298/0 (socket says 172.21.15.149:35298) 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6121e00640 1 -- 172.21.15.149:0/275079561 learned_addr learned my addr 172.21.15.149:0/275079561 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:16.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6122800640 1 --2- 172.21.15.149:0/275079561 >> v2:172.21.15.149:3300/0 conn(0x7f6124155a30 0x7f612406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6121400640 1 --2- 172.21.15.149:0/275079561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61240ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6120a00640 1 -- 172.21.15.149:0/275079561 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962981440 0 0) 0x7f61240afc40 con 0x7f6124155660 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6120a00640 1 -- 172.21.15.149:0/275079561 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61080034e0 con 0x7f6124155660 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6122800640 1 -- 172.21.15.149:0/275079561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 msgr2=0x7f61240ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6122800640 1 --2- 172.21.15.149:0/275079561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61240ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6122800640 1 -- 172.21.15.149:0/275079561 >> v1:172.21.15.149:6789/0 conn(0x7f6124155660 legacy=0x7f61240c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.136+0000 7f6122800640 1 -- 172.21.15.149:0/275079561 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240af5f0 con 0x7f6124155a30 2024-08-17T02:47:16.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.137+0000 7f6122800640 1 --2- 172.21.15.149:0/275079561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155a30 0x7f612406dec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f611c009e60 tx=0x7f611c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8c5c507dd19962 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6120a00640 1 -- 172.21.15.149:0/275079561 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c007550 con 0x7f6124155a30 2024-08-17T02:47:16.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6120a00640 1 -- 172.21.15.149:0/275079561 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c02d050 con 0x7f6124155a30 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6120a00640 1 -- 172.21.15.149:0/275079561 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c007920 con 0x7f6124155a30 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 -- 172.21.15.149:0/275079561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155a30 msgr2=0x7f612406dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 --2- 172.21.15.149:0/275079561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155a30 0x7f612406dec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f611c009e60 tx=0x7f611c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 -- 172.21.15.149:0/275079561 shutdown_connections 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 --2- 172.21.15.149:0/275079561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155a30 0x7f612406dec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 --2- 172.21.15.149:0/275079561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61240ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 -- 172.21.15.149:0/275079561 >> 172.21.15.149:0/275079561 conn(0x7f6124066cd0 msgr2=0x7f61240670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 -- 172.21.15.149:0/275079561 shutdown_connections 2024-08-17T02:47:16.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.138+0000 7f6123200640 1 -- 172.21.15.149:0/275079561 wait complete. 2024-08-17T02:47:16.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.140+0000 7f6123200640 1 Processor -- start 2024-08-17T02:47:16.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.140+0000 7f6123200640 1 -- start start 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6123200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61241533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6123200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 0x7f612414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6123200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6124155a30 0x7f61241515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6123200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124151ae0 con 0x7f6124155660 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6123200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124151d10 con 0x7f6124155a30 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6123200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6124151ff0 con 0x7f61240adfb0 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 0x7f612414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 0x7f612414a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52748/0 (socket says 172.21.15.149:52748) 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 -- 172.21.15.149:0/3212214864 learned_addr learned my addr 172.21.15.149:0/3212214864 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121e00640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61241533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6122800640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6124155a30 0x7f61241515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 -- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 msgr2=0x7f61241533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61241533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 -- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6124155a30 msgr2=0x7f61241515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6124155a30 0x7f61241515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6121400640 1 -- 172.21.15.149:0/3212214864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c009a20 con 0x7f6124155660 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.141+0000 7f6122800640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6124155a30 0x7f61241515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.142+0000 7f6121400640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 0x7f612414a3b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f611000d890 tx=0x7f6110008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.142+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000de20 con 0x7f6124155660 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.142+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000b8d0 con 0x7f6124155660 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.142+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000bc70 con 0x7f6124155660 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.142+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61241522d0 con 0x7f6124155660 2024-08-17T02:47:16.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.142+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612414bb30 con 0x7f6124155660 2024-08-17T02:47:16.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.143+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6124071050 con 0x7f6124155660 2024-08-17T02:47:16.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.144+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6110014640 con 0x7f6124155660 2024-08-17T02:47:16.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.145+0000 7f6119600640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6104065150 0x7f6104067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.145+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6110082ab0 con 0x7f6124155660 2024-08-17T02:47:16.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.145+0000 7f6121e00640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6104065150 0x7f6104067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.146+0000 7f6121e00640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6104065150 0x7f6104067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f612414acb0 tx=0x7f6114009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.149+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6110050b90 con 0x7f6124155660 2024-08-17T02:47:16.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.323+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f612414bcf0 con 0x7f6124155660 2024-08-17T02:47:16.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.323+0000 7f6119600640 1 -- 172.21.15.149:0/3212214864 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61100541b0 con 0x7f6124155660 2024-08-17T02:47:16.325 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:16.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.325+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6104065150 msgr2=0x7f6104067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.325+0000 7f6123200640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6104065150 0x7f6104067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f612414acb0 tx=0x7f6114009040 comp rx=0 tx=0).stop 2024-08-17T02:47:16.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.325+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 msgr2=0x7f612414a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 0x7f612414a3b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f611000d890 tx=0x7f6110008040 comp rx=0 tx=0).stop 2024-08-17T02:47:16.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 shutdown_connections 2024-08-17T02:47:16.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6104065150 0x7f6104067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6124155a30 0x7f61241515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6124155660 0x7f612414a3b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 --2- 172.21.15.149:0/3212214864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61240adfb0 0x7f61241533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 >> 172.21.15.149:0/3212214864 conn(0x7f6124066cd0 msgr2=0x7f61240affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 shutdown_connections 2024-08-17T02:47:16.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.326+0000 7f6123200640 1 -- 172.21.15.149:0/3212214864 wait complete. 2024-08-17T02:47:16.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:16.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.501+0000 7f2126a00640 1 Processor -- start 2024-08-17T02:47:16.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.501+0000 7f2126a00640 1 -- start start 2024-08-17T02:47:16.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2126a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f21200ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2126a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2120096ee0 0x7f21200ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2126a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200ce580 con 0x7f2120156c40 2024-08-17T02:47:16.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2126a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200abfb0 con 0x7f2120096ee0 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2126a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200ac1a0 con 0x7f2120156870 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2124c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2120096ee0 0x7f21200ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2124c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2120096ee0 0x7f21200ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52760/0 (socket says 172.21.15.149:52760) 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2124c00640 1 -- 172.21.15.149:0/448196398 learned_addr learned my addr 172.21.15.149:0/448196398 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2125600640 1 --2- 172.21.15.149:0/448196398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f21200ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2124c00640 1 -- 172.21.15.149:0/448196398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 msgr2=0x7f21200ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.503+0000 7f2124c00640 1 --2- 172.21.15.149:0/448196398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f21200ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.504+0000 7f2124c00640 1 -- 172.21.15.149:0/448196398 >> v1:172.21.15.149:6789/0 conn(0x7f2120156c40 legacy=0x7f21200ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.504+0000 7f2124c00640 1 -- 172.21.15.149:0/448196398 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200ac480 con 0x7f2120096ee0 2024-08-17T02:47:16.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.504+0000 7f211fe00640 1 -- 172.21.15.149:0/448196398 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124795143 0 0) 0x7f21200ce580 con 0x7f2120156c40 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.505+0000 7f2124c00640 1 --2- 172.21.15.149:0/448196398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21200ae510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f210c009910 tx=0x7f210c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2707045bdf448be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.505+0000 7f211fe00640 1 -- 172.21.15.149:0/448196398 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c02ae40 con 0x7f2120096ee0 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.505+0000 7f211fe00640 1 -- 172.21.15.149:0/448196398 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c032440 con 0x7f2120096ee0 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.505+0000 7f211fe00640 1 -- 172.21.15.149:0/448196398 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0327e0 con 0x7f2120096ee0 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.505+0000 7f2126a00640 1 -- 172.21.15.149:0/448196398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 msgr2=0x7f21200ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.505+0000 7f2126a00640 1 --2- 172.21.15.149:0/448196398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21200ae510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f210c009910 tx=0x7f210c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.506+0000 7f2126a00640 1 -- 172.21.15.149:0/448196398 shutdown_connections 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.506+0000 7f2126a00640 1 --2- 172.21.15.149:0/448196398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21200ae510 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.506+0000 7f2126a00640 1 --2- 172.21.15.149:0/448196398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f21200ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.506+0000 7f2126a00640 1 -- 172.21.15.149:0/448196398 >> 172.21.15.149:0/448196398 conn(0x7f2120096a70 msgr2=0x7f21200cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.506+0000 7f2126a00640 1 -- 172.21.15.149:0/448196398 shutdown_connections 2024-08-17T02:47:16.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.506+0000 7f2126a00640 1 -- 172.21.15.149:0/448196398 wait complete. 2024-08-17T02:47:16.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.507+0000 7f2126a00640 1 Processor -- start 2024-08-17T02:47:16.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.507+0000 7f2126a00640 1 -- start start 2024-08-17T02:47:16.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21201428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f2120154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2120156c40 0x7f21201545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212009a0e0 con 0x7f2120096ee0 2024-08-17T02:47:16.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212009a570 con 0x7f2120156c40 2024-08-17T02:47:16.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200994d0 con 0x7f2120156870 2024-08-17T02:47:16.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2125600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21201428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2125600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21201428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:52762/0 (socket says 172.21.15.149:52762) 2024-08-17T02:47:16.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2125600640 1 -- 172.21.15.149:0/442881359 learned_addr learned my addr 172.21.15.149:0/442881359 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:16.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2124c00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f2120154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.508+0000 7f2126000640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2120156c40 0x7f21201545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2125600640 1 -- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 msgr2=0x7f2120154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2125600640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f2120154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2125600640 1 -- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2120156c40 msgr2=0x7f21201545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2125600640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2120156c40 0x7f21201545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2125600640 1 -- 172.21.15.149:0/442881359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c009450 con 0x7f2120096ee0 2024-08-17T02:47:16.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2125600640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21201428c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f211400d890 tx=0x7f2114008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400de20 con 0x7f2120096ee0 2024-08-17T02:47:16.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400b960 con 0x7f2120096ee0 2024-08-17T02:47:16.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400bd00 con 0x7f2120096ee0 2024-08-17T02:47:16.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21200997b0 con 0x7f2120096ee0 2024-08-17T02:47:16.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.509+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2120099d70 con 0x7f2120096ee0 2024-08-17T02:47:16.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.511+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120071050 con 0x7f2120096ee0 2024-08-17T02:47:16.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.511+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2114014640 con 0x7f2120096ee0 2024-08-17T02:47:16.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.512+0000 7f211cc00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2100065180 0x7f2100067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.512+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2114082b10 con 0x7f2120096ee0 2024-08-17T02:47:16.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.512+0000 7f2124c00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2100065180 0x7f2100067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.513+0000 7f2124c00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2100065180 0x7f2100067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f210c034000 tx=0x7f210c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.516+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2114050c90 con 0x7f2120096ee0 2024-08-17T02:47:16.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.694+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21200b17c0 con 0x7f2120096ee0 2024-08-17T02:47:16.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.695+0000 7f211cc00640 1 -- 172.21.15.149:0/442881359 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f211400be60 con 0x7f2120096ee0 2024-08-17T02:47:16.696 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:16.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2100065180 msgr2=0x7f2100067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2100065180 0x7f2100067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f210c034000 tx=0x7f210c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 msgr2=0x7f21201428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21201428c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f211400d890 tx=0x7f2114008040 comp rx=0 tx=0).stop 2024-08-17T02:47:16.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 shutdown_connections 2024-08-17T02:47:16.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2100065180 0x7f2100067630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2120156c40 0x7f21201545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2120156870 0x7f2120154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 --2- 172.21.15.149:0/442881359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2120096ee0 0x7f21201428c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.697+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 >> 172.21.15.149:0/442881359 conn(0x7f2120096a70 msgr2=0x7f21200b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.698+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 shutdown_connections 2024-08-17T02:47:16.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.698+0000 7f2126a00640 1 -- 172.21.15.149:0/442881359 wait complete. 2024-08-17T02:47:16.715 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.869+0000 7fda2ea00640 1 Processor -- start 2024-08-17T02:47:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.870+0000 7fda2ea00640 1 -- start start 2024-08-17T02:47:16.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda280ceb40 0x7fda280cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda280ccad0 0x7fda28162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2ea00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda280ccf30 con 0x7fda28159ca0 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2ea00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda280cd6e0 con 0x7fda280ccad0 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2ea00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda280cadc0 con 0x7fda280ceb40 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda280ccad0 0x7fda28162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda280ccad0 0x7fda28162860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49804/0 (socket says 172.21.15.149:49804) 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2e000640 1 -- 172.21.15.149:0/2853751629 learned_addr learned my addr 172.21.15.149:0/2853751629 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2cc00640 1 --2- 172.21.15.149:0/2853751629 >> v2:172.21.15.161:3300/0 conn(0x7fda280ceb40 0x7fda280cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2e000640 1 -- 172.21.15.149:0/2853751629 >> v2:172.21.15.161:3300/0 conn(0x7fda280ceb40 msgr2=0x7fda280cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.871+0000 7fda2e000640 1 --2- 172.21.15.149:0/2853751629 >> v2:172.21.15.161:3300/0 conn(0x7fda280ceb40 0x7fda280cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.872+0000 7fda2e000640 1 -- 172.21.15.149:0/2853751629 >> v1:172.21.15.161:6789/0 conn(0x7fda28159ca0 legacy=0x7fda280ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.872+0000 7fda2e000640 1 -- 172.21.15.149:0/2853751629 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280cb060 con 0x7fda280ccad0 2024-08-17T02:47:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.873+0000 7fda2e000640 1 --2- 172.21.15.149:0/2853751629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ccad0 0x7fda28162860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda2808a060 tx=0x7fda20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0910d7943edad4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.874 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.873+0000 7fda27e00640 1 -- 172.21.15.149:0/2853751629 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2002e050 con 0x7fda280ccad0 2024-08-17T02:47:16.874 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.873+0000 7fda27e00640 1 -- 172.21.15.149:0/2853751629 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20007400 con 0x7fda280ccad0 2024-08-17T02:47:16.874 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.873+0000 7fda27e00640 1 -- 172.21.15.149:0/2853751629 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200077e0 con 0x7fda280ccad0 2024-08-17T02:47:16.874 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 -- 172.21.15.149:0/2853751629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ccad0 msgr2=0x7fda28162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.874 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 --2- 172.21.15.149:0/2853751629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ccad0 0x7fda28162860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda2808a060 tx=0x7fda20009840 comp rx=0 tx=0).stop 2024-08-17T02:47:16.875 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 -- 172.21.15.149:0/2853751629 shutdown_connections 2024-08-17T02:47:16.875 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 --2- 172.21.15.149:0/2853751629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ccad0 0x7fda28162860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.875 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 --2- 172.21.15.149:0/2853751629 >> v2:172.21.15.161:3300/0 conn(0x7fda280ceb40 0x7fda280cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.876 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 -- 172.21.15.149:0/2853751629 >> 172.21.15.149:0/2853751629 conn(0x7fda28098e00 msgr2=0x7fda2806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.876 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 -- 172.21.15.149:0/2853751629 shutdown_connections 2024-08-17T02:47:16.876 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.874+0000 7fda2ea00640 1 -- 172.21.15.149:0/2853751629 wait complete. 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.875+0000 7fda2ea00640 1 Processor -- start 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.875+0000 7fda2ea00640 1 -- start start 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda280ccad0 0x7fda2816bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 0x7fda280c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda28159ca0 0x7fda28169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28155990 con 0x7fda280ceb40 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2ea00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280c6bc0 con 0x7fda28159ca0 2024-08-17T02:47:16.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280c7740 con 0x7fda280ccad0 2024-08-17T02:47:16.878 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.876+0000 7fda2cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 0x7fda280c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.878 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 0x7fda280c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49812/0 (socket says 172.21.15.149:49812) 2024-08-17T02:47:16.878 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 -- 172.21.15.149:0/1253991478 learned_addr learned my addr 172.21.15.149:0/1253991478 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:16.878 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2e000640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda28159ca0 0x7fda28169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.878 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2d600640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda280ccad0 0x7fda2816bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 -- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda280ccad0 msgr2=0x7fda2816bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda280ccad0 0x7fda2816bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 -- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda28159ca0 msgr2=0x7fda28169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda28159ca0 0x7fda28169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 -- 172.21.15.149:0/1253991478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009ae0 con 0x7fda280ceb40 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.877+0000 7fda2cc00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 0x7fda280c5600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda1400d890 tx=0x7fda14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.878+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400de20 con 0x7fda280ceb40 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.878+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1400b8d0 con 0x7fda280ceb40 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.878+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400bc70 con 0x7fda280ceb40 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.878+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280c5b40 con 0x7fda280ceb40 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.878+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280c6e10 con 0x7fda280ceb40 2024-08-17T02:47:16.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.879+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2806eb90 con 0x7fda280ceb40 2024-08-17T02:47:16.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.881+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fda14014640 con 0x7fda280ceb40 2024-08-17T02:47:16.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.881+0000 7fda24c00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fda08065150 0x7fda08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.882+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda14082960 con 0x7fda280ceb40 2024-08-17T02:47:16.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.882+0000 7fda2d600640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fda08065150 0x7fda08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.883 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.882+0000 7fda2d600640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fda08065150 0x7fda08067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda280b5010 tx=0x7fda1c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:16.886+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fda2806eb90 con 0x7fda280ceb40 2024-08-17T02:47:17.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.068+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda2806eb90 con 0x7fda280ceb40 2024-08-17T02:47:17.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.069+0000 7fda24c00640 1 -- 172.21.15.149:0/1253991478 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fda2806eb90 con 0x7fda280ceb40 2024-08-17T02:47:17.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:17.070 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:17.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.071+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fda08065150 msgr2=0x7fda08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fda08065150 0x7fda08067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda280b5010 tx=0x7fda1c007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 msgr2=0x7fda280c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 0x7fda280c5600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda1400d890 tx=0x7fda14008040 comp rx=0 tx=0).stop 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 shutdown_connections 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fda08065150 0x7fda08067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda28159ca0 0x7fda28169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda280ceb40 0x7fda280c5600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 --2- 172.21.15.149:0/1253991478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda280ccad0 0x7fda2816bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 >> 172.21.15.149:0/1253991478 conn(0x7fda28098e00 msgr2=0x7fda28156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 shutdown_connections 2024-08-17T02:47:17.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.072+0000 7fda2ea00640 1 -- 172.21.15.149:0/1253991478 wait complete. 2024-08-17T02:47:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:17.089 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:17.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.247+0000 7f0d27200640 1 Processor -- start 2024-08-17T02:47:17.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.247+0000 7f0d27200640 1 -- start start 2024-08-17T02:47:17.249 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d27200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0d200b2d20 0x7f0d200b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d27200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d200b3d40 0x7f0d2015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d27200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200b4d80 con 0x7f0d200cc350 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d27200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d200b5060 con 0x7f0d200b3d40 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d27200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d200b5340 con 0x7f0d200b2d20 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d1f400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0d200cc350 0x7f0d200b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45132/0 (socket says 172.21.15.149:45132) 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d1f400640 1 -- 172.21.15.149:0/1697768346 learned_addr learned my addr 172.21.15.149:0/1697768346 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d25200640 1 --2- 172.21.15.149:0/1697768346 >> v2:172.21.15.149:3300/0 conn(0x7f0d200b3d40 0x7f0d2015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d1ea00640 1 -- 172.21.15.149:0/1697768346 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216908107 0 0) 0x7f0d200b4d80 con 0x7f0d200cc350 2024-08-17T02:47:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.249+0000 7f0d1ea00640 1 -- 172.21.15.149:0/1697768346 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d040034e0 con 0x7f0d200cc350 2024-08-17T02:47:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.250+0000 7f0d25200640 1 -- 172.21.15.149:0/1697768346 >> v2:172.21.15.161:3300/0 conn(0x7f0d200b2d20 msgr2=0x7f0d200b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.250+0000 7f0d25200640 1 --2- 172.21.15.149:0/1697768346 >> v2:172.21.15.161:3300/0 conn(0x7f0d200b2d20 0x7f0d200b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.250+0000 7f0d25200640 1 -- 172.21.15.149:0/1697768346 >> v1:172.21.15.149:6789/0 conn(0x7f0d200cc350 legacy=0x7f0d200b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.250+0000 7f0d25200640 1 -- 172.21.15.149:0/1697768346 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200b5620 con 0x7f0d200b3d40 2024-08-17T02:47:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.251+0000 7f0d25200640 1 --2- 172.21.15.149:0/1697768346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d2015a1f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009e60 tx=0x7f0d18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c6ca29b2ea516a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.251+0000 7f0d1ea00640 1 -- 172.21.15.149:0/1697768346 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007550 con 0x7f0d200b3d40 2024-08-17T02:47:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.251+0000 7f0d1ea00640 1 -- 172.21.15.149:0/1697768346 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1802d050 con 0x7f0d200b3d40 2024-08-17T02:47:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.251+0000 7f0d1ea00640 1 -- 172.21.15.149:0/1697768346 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007900 con 0x7f0d200b3d40 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 -- 172.21.15.149:0/1697768346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 msgr2=0x7f0d2015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 --2- 172.21.15.149:0/1697768346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d2015a1f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009e60 tx=0x7f0d18009780 comp rx=0 tx=0).stop 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 -- 172.21.15.149:0/1697768346 shutdown_connections 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 --2- 172.21.15.149:0/1697768346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d2015a1f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 --2- 172.21.15.149:0/1697768346 >> v2:172.21.15.161:3300/0 conn(0x7f0d200b2d20 0x7f0d200b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 -- 172.21.15.149:0/1697768346 >> 172.21.15.149:0/1697768346 conn(0x7f0d200cfdd0 msgr2=0x7f0d200d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 -- 172.21.15.149:0/1697768346 shutdown_connections 2024-08-17T02:47:17.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.252+0000 7f0d27200640 1 -- 172.21.15.149:0/1697768346 wait complete. 2024-08-17T02:47:17.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.253+0000 7f0d27200640 1 Processor -- start 2024-08-17T02:47:17.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 -- start start 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d200b2d20 0x7f0d2015cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d201527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d200cc350 0x7f0d200cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200cd460 con 0x7f0d200b3d40 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015b930 con 0x7f0d200cc350 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.254+0000 7f0d27200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200cc850 con 0x7f0d200b2d20 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d201527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d201527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49820/0 (socket says 172.21.15.149:49820) 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 -- 172.21.15.149:0/3249967701 learned_addr learned my addr 172.21.15.149:0/3249967701 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d25200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d200cc350 0x7f0d200cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1fe00640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d200b2d20 0x7f0d2015cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 -- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d200b2d20 msgr2=0x7f0d2015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d200b2d20 0x7f0d2015cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 -- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d200cc350 msgr2=0x7f0d200cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d200cc350 0x7f0d200cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 -- 172.21.15.149:0/3249967701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18009a20 con 0x7f0d200b3d40 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1fe00640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d200b2d20 0x7f0d2015cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.255+0000 7f0d1f400640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d201527d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c4b0 tx=0x7f0d0c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.256+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c005aa0 con 0x7f0d200b3d40 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.256+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c005c00 con 0x7f0d200b3d40 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.256+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d200ccb30 con 0x7f0d200b3d40 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.256+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0070d0 con 0x7f0d200b3d40 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.256+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d200cd0f0 con 0x7f0d200b3d40 2024-08-17T02:47:17.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.257+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d20064db0 con 0x7f0d200b3d40 2024-08-17T02:47:17.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.258+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0d0c0074c0 con 0x7f0d200b3d40 2024-08-17T02:47:17.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.258+0000 7f0d17400640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d00065150 0x7f0d00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.259+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d0c0818c0 con 0x7f0d200b3d40 2024-08-17T02:47:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.259+0000 7f0d1fe00640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d00065150 0x7f0d00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.259+0000 7f0d1fe00640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d00065150 0x7f0d00067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009a80 tx=0x7f0d10008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.262+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0d0c04f990 con 0x7f0d200b3d40 2024-08-17T02:47:17.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.440+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d200b1de0 con 0x7f0d200b3d40 2024-08-17T02:47:17.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.441+0000 7f0d17400640 1 -- 172.21.15.149:0/3249967701 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d0c017020 con 0x7f0d200b3d40 2024-08-17T02:47:17.442 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:17.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d00065150 msgr2=0x7f0d00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d00065150 0x7f0d00067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009a80 tx=0x7f0d10008040 comp rx=0 tx=0).stop 2024-08-17T02:47:17.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 msgr2=0x7f0d201527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d201527d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c4b0 tx=0x7f0d0c007d60 comp rx=0 tx=0).stop 2024-08-17T02:47:17.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 shutdown_connections 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0d00065150 0x7f0d00067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d200cc350 0x7f0d200cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d200b3d40 0x7f0d201527d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 --2- 172.21.15.149:0/3249967701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d200b2d20 0x7f0d2015cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.443+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 >> 172.21.15.149:0/3249967701 conn(0x7f0d200cfdd0 msgr2=0x7f0d200b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.444+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 shutdown_connections 2024-08-17T02:47:17.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.444+0000 7f0d27200640 1 -- 172.21.15.149:0/3249967701 wait complete. 2024-08-17T02:47:17.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:17.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.612+0000 7ffb3a800640 1 Processor -- start 2024-08-17T02:47:17.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.612+0000 7ffb3a800640 1 -- start start 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.613+0000 7ffb3a800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffb340c4a20 0x7ffb340ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.613+0000 7ffb3a800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb34158e00 0x7ffb340ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.613+0000 7ffb3a800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340c61d0 con 0x7ffb34158a30 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.613+0000 7ffb3a800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340c5fe0 con 0x7ffb34158e00 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.613+0000 7ffb3a800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340c64b0 con 0x7ffb340c4a20 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb34158e00 0x7ffb340ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb34158e00 0x7ffb340ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49832/0 (socket says 172.21.15.149:49832) 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb38a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffb340c4a20 0x7ffb340ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 -- 172.21.15.149:0/619429056 learned_addr learned my addr 172.21.15.149:0/619429056 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 -- 172.21.15.149:0/619429056 >> v2:172.21.15.161:3300/0 conn(0x7ffb340c4a20 msgr2=0x7ffb340ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 --2- 172.21.15.149:0/619429056 >> v2:172.21.15.161:3300/0 conn(0x7ffb340c4a20 0x7ffb340ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 -- 172.21.15.149:0/619429056 >> v1:172.21.15.161:6789/0 conn(0x7ffb34158a30 legacy=0x7ffb340c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.614+0000 7ffb39e00640 1 -- 172.21.15.149:0/619429056 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340c6790 con 0x7ffb34158e00 2024-08-17T02:47:17.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.616+0000 7ffb39e00640 1 --2- 172.21.15.149:0/619429056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340ce6c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb340ca1e0 tx=0x7ffb2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe4615d75d95cab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.616+0000 7ffb33e00640 1 -- 172.21.15.149:0/619429056 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c031400 con 0x7ffb34158e00 2024-08-17T02:47:17.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.616+0000 7ffb33e00640 1 -- 172.21.15.149:0/619429056 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c02d050 con 0x7ffb34158e00 2024-08-17T02:47:17.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.616+0000 7ffb33e00640 1 -- 172.21.15.149:0/619429056 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0317d0 con 0x7ffb34158e00 2024-08-17T02:47:17.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 -- 172.21.15.149:0/619429056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 msgr2=0x7ffb340ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 --2- 172.21.15.149:0/619429056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340ce6c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb340ca1e0 tx=0x7ffb2c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 -- 172.21.15.149:0/619429056 shutdown_connections 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 --2- 172.21.15.149:0/619429056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340ce6c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 --2- 172.21.15.149:0/619429056 >> v2:172.21.15.161:3300/0 conn(0x7ffb340c4a20 0x7ffb340ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 -- 172.21.15.149:0/619429056 >> 172.21.15.149:0/619429056 conn(0x7ffb34098e30 msgr2=0x7ffb3406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 -- 172.21.15.149:0/619429056 shutdown_connections 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.617+0000 7ffb3a800640 1 -- 172.21.15.149:0/619429056 wait complete. 2024-08-17T02:47:17.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.618+0000 7ffb3a800640 1 Processor -- start 2024-08-17T02:47:17.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.618+0000 7ffb3a800640 1 -- start start 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb3a800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb340c4a20 0x7ffb34169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb3a800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb34158a30 0x7ffb34159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb3a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb3a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3415adc0 con 0x7ffb34158e00 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb3a800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340b2e50 con 0x7ffb34158a30 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb3a800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c6f20 con 0x7ffb340c4a20 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb39e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb39e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49840/0 (socket says 172.21.15.149:49840) 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.619+0000 7ffb39e00640 1 -- 172.21.15.149:0/3739145439 learned_addr learned my addr 172.21.15.149:0/3739145439 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb38a00640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb34158a30 0x7ffb34159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39400640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb340c4a20 0x7ffb34169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39e00640 1 -- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb340c4a20 msgr2=0x7ffb34169190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39e00640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb340c4a20 0x7ffb34169190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39e00640 1 -- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb34158a30 msgr2=0x7ffb34159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39e00640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb34158a30 0x7ffb34159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39e00640 1 -- 172.21.15.149:0/3739145439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009ae0 con 0x7ffb34158e00 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39400640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb340c4a20 0x7ffb34169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:17.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.620+0000 7ffb39e00640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340c87b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c02acd0 tx=0x7ffb2c034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.621+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c007170 con 0x7ffb34158e00 2024-08-17T02:47:17.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.621+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c008e50 con 0x7ffb34158e00 2024-08-17T02:47:17.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.621+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c03b640 con 0x7ffb34158e00 2024-08-17T02:47:17.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.621+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3415a800 con 0x7ffb34158e00 2024-08-17T02:47:17.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.621+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3415ab90 con 0x7ffb34158e00 2024-08-17T02:47:17.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.622+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340b2fe0 con 0x7ffb34158e00 2024-08-17T02:47:17.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.623+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb2c038050 con 0x7ffb34158e00 2024-08-17T02:47:17.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.624+0000 7ffb30c00640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb14065150 0x7ffb14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.624+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb2c0a3090 con 0x7ffb34158e00 2024-08-17T02:47:17.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.624+0000 7ffb39400640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb14065150 0x7ffb14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.624+0000 7ffb39400640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb14065150 0x7ffb14067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb280017a0 tx=0x7ffb28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.628+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffb2c071150 con 0x7ffb34158e00 2024-08-17T02:47:17.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.805+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb34071050 con 0x7ffb34158e00 2024-08-17T02:47:17.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.806+0000 7ffb30c00640 1 -- 172.21.15.149:0/3739145439 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb2c074770 con 0x7ffb34158e00 2024-08-17T02:47:17.807 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:17.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb14065150 msgr2=0x7ffb14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb14065150 0x7ffb14067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb280017a0 tx=0x7ffb28009040 comp rx=0 tx=0).stop 2024-08-17T02:47:17.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 msgr2=0x7ffb340c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340c87b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c02acd0 tx=0x7ffb2c034000 comp rx=0 tx=0).stop 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 shutdown_connections 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb14065150 0x7ffb14067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb34158e00 0x7ffb340c87b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb34158a30 0x7ffb34159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 --2- 172.21.15.149:0/3739145439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb340c4a20 0x7ffb34169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 >> 172.21.15.149:0/3739145439 conn(0x7ffb34098e30 msgr2=0x7ffb34156410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.808+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 shutdown_connections 2024-08-17T02:47:17.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.809+0000 7ffb3a800640 1 -- 172.21.15.149:0/3739145439 wait complete. 2024-08-17T02:47:17.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.976+0000 7fea9d200640 1 Processor -- start 2024-08-17T02:47:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.976+0000 7fea9d200640 1 -- start start 2024-08-17T02:47:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.977+0000 7fea9d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea980adfb0 0x7fea980ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea9d200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fea98155a30 0x7fea9806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea9d200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980afc40 con 0x7fea98155660 2024-08-17T02:47:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea9d200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980af030 con 0x7fea98155a30 2024-08-17T02:47:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea9d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea980af310 con 0x7fea980adfb0 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fea98155a30 0x7fea9806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fea98155a30 0x7fea9806dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49854/0 (socket says 172.21.15.149:49854) 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 -- 172.21.15.149:0/2169475767 learned_addr learned my addr 172.21.15.149:0/2169475767 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea8fe00640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea980adfb0 0x7fea980ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 -- 172.21.15.149:0/2169475767 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea980adfb0 msgr2=0x7fea980ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea980adfb0 0x7fea980ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 -- 172.21.15.149:0/2169475767 >> v1:172.21.15.161:6789/0 conn(0x7fea98155660 legacy=0x7fea980c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea97e00640 1 -- 172.21.15.149:0/2169475767 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980af5f0 con 0x7fea98155a30 2024-08-17T02:47:17.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.978+0000 7fea8fe00640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea980adfb0 0x7fea980ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:17.981 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.979+0000 7fea97e00640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea98155a30 0x7fea9806dec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea90009f20 tx=0x7fea90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f200c9645cb47a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.979+0000 7fea96a00640 1 -- 172.21.15.149:0/2169475767 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90031400 con 0x7fea98155a30 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea96a00640 1 -- 172.21.15.149:0/2169475767 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9002d050 con 0x7fea98155a30 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea96a00640 1 -- 172.21.15.149:0/2169475767 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900317d0 con 0x7fea98155a30 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 -- 172.21.15.149:0/2169475767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea98155a30 msgr2=0x7fea9806dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea98155a30 0x7fea9806dec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea90009f20 tx=0x7fea90009840 comp rx=0 tx=0).stop 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 -- 172.21.15.149:0/2169475767 shutdown_connections 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea98155a30 0x7fea9806dec0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 --2- 172.21.15.149:0/2169475767 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea980adfb0 0x7fea980ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 -- 172.21.15.149:0/2169475767 >> 172.21.15.149:0/2169475767 conn(0x7fea98066cd0 msgr2=0x7fea980670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 -- 172.21.15.149:0/2169475767 shutdown_connections 2024-08-17T02:47:17.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.980+0000 7fea9d200640 1 -- 172.21.15.149:0/2169475767 wait complete. 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.982+0000 7fea9d200640 1 Processor -- start 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.982+0000 7fea9d200640 1 -- start start 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea9d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 0x7fea98167060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea9d200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea98155660 0x7fea98158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea9d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea98155a30 0x7fea9814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea9d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9816a970 con 0x7fea980adfb0 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea9d200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9816a620 con 0x7fea98155660 2024-08-17T02:47:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea9d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea981675a0 con 0x7fea98155a30 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 0x7fea98167060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 0x7fea98167060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49860/0 (socket says 172.21.15.149:49860) 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 -- 172.21.15.149:0/3546646284 learned_addr learned my addr 172.21.15.149:0/3546646284 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea8fe00640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea98155660 0x7fea98158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97e00640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea98155a30 0x7fea9814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 -- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea98155a30 msgr2=0x7fea9814ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea98155a30 0x7fea9814ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 -- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea98155660 msgr2=0x7fea98158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea98155660 0x7fea98158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97400640 1 -- 172.21.15.149:0/3546646284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009ae0 con 0x7fea980adfb0 2024-08-17T02:47:17.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.983+0000 7fea97e00640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea98155a30 0x7fea9814ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:17.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.984+0000 7fea97400640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 0x7fea98167060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c560 tx=0x7fea88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.984+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88011590 con 0x7fea980adfb0 2024-08-17T02:47:17.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.984+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88011710 con 0x7fea980adfb0 2024-08-17T02:47:17.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.984+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88011ad0 con 0x7fea980adfb0 2024-08-17T02:47:17.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.984+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea98167870 con 0x7fea980adfb0 2024-08-17T02:47:17.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.984+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea98167e30 con 0x7fea980adfb0 2024-08-17T02:47:17.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.985+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea98071050 con 0x7fea980adfb0 2024-08-17T02:47:17.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.986+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea8801b3b0 con 0x7fea980adfb0 2024-08-17T02:47:17.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.986+0000 7fea8ea00640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fea74065150 0x7fea74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.987+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea880819e0 con 0x7fea980adfb0 2024-08-17T02:47:17.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.987+0000 7fea8fe00640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fea74065150 0x7fea74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.988+0000 7fea8fe00640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fea74065150 0x7fea74067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea9815c180 tx=0x7fea80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:17.991+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea8804fab0 con 0x7fea980adfb0 2024-08-17T02:47:18.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.163+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea9806c5f0 con 0x7fea980adfb0 2024-08-17T02:47:18.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.164+0000 7fea8ea00640 1 -- 172.21.15.149:0/3546646284 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea88017070 con 0x7fea980adfb0 2024-08-17T02:47:18.165 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fea74065150 msgr2=0x7fea74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fea74065150 0x7fea74067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea9815c180 tx=0x7fea80008040 comp rx=0 tx=0).stop 2024-08-17T02:47:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 msgr2=0x7fea98167060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 0x7fea98167060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c560 tx=0x7fea88007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 shutdown_connections 2024-08-17T02:47:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fea74065150 0x7fea74067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea98155a30 0x7fea9814ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea98155660 0x7fea98158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 --2- 172.21.15.149:0/3546646284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea980adfb0 0x7fea98167060 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 >> 172.21.15.149:0/3546646284 conn(0x7fea98066cd0 msgr2=0x7fea9815b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 shutdown_connections 2024-08-17T02:47:18.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.166+0000 7fea9d200640 1 -- 172.21.15.149:0/3546646284 wait complete. 2024-08-17T02:47:18.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.330+0000 7f25d0000640 1 Processor -- start 2024-08-17T02:47:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.330+0000 7f25d0000640 1 -- start start 2024-08-17T02:47:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25d0000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25c80b1440 0x7f25c80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25d0000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c80caa80 con 0x7f25c81401b0 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25d0000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c80c9e70 con 0x7f25c8140580 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25d0000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c80cb450 con 0x7f25c80b1440 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25ccc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25c80b1440 0x7f25c80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25cd600640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f25c81401b0 0x7f25c80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45142/0 (socket says 172.21.15.149:45142) 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25cd600640 1 -- 172.21.15.149:0/1386626213 learned_addr learned my addr 172.21.15.149:0/1386626213 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25ccc00640 1 -- 172.21.15.149:0/1386626213 >> v1:172.21.15.161:6789/0 conn(0x7f25c8140580 legacy=0x7f25c80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25ccc00640 1 -- 172.21.15.149:0/1386626213 >> v1:172.21.15.149:6789/0 conn(0x7f25c81401b0 legacy=0x7f25c80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.332+0000 7f25ccc00640 1 -- 172.21.15.149:0/1386626213 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c80ca150 con 0x7f25c80b1440 2024-08-17T02:47:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.333+0000 7f25ccc00640 1 --2- 172.21.15.149:0/1386626213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c80b1440 0x7f25c80caf10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009850 tx=0x7f25b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3e5cb0f177cd0d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25c7e00640 1 -- 172.21.15.149:0/1386626213 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b402ad90 con 0x7f25c80b1440 2024-08-17T02:47:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25c7e00640 1 -- 172.21.15.149:0/1386626213 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4032440 con 0x7f25c80b1440 2024-08-17T02:47:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25c7e00640 1 -- 172.21.15.149:0/1386626213 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4032820 con 0x7f25c80b1440 2024-08-17T02:47:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 -- 172.21.15.149:0/1386626213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c80b1440 msgr2=0x7f25c80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 --2- 172.21.15.149:0/1386626213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c80b1440 0x7f25c80caf10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009850 tx=0x7f25b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 -- 172.21.15.149:0/1386626213 shutdown_connections 2024-08-17T02:47:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 --2- 172.21.15.149:0/1386626213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c80b1440 0x7f25c80caf10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 -- 172.21.15.149:0/1386626213 >> 172.21.15.149:0/1386626213 conn(0x7f25c80cb9b0 msgr2=0x7f25c80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 -- 172.21.15.149:0/1386626213 shutdown_connections 2024-08-17T02:47:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.334+0000 7f25d0000640 1 -- 172.21.15.149:0/1386626213 wait complete. 2024-08-17T02:47:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.336+0000 7f25d0000640 1 Processor -- start 2024-08-17T02:47:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.336+0000 7f25d0000640 1 -- start start 2024-08-17T02:47:18.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25d0000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25c80b1440 0x7f25c813e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25d0000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25c81401b0 0x7f25c816acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25d0000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 0x7f25c815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25d0000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c816b210 con 0x7f25c8140580 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25d0000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80abef0 con 0x7f25c81401b0 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25d0000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80ab8e0 con 0x7f25c80b1440 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 0x7f25c815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 0x7f25c815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49878/0 (socket says 172.21.15.149:49878) 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 -- 172.21.15.149:0/1990144241 learned_addr learned my addr 172.21.15.149:0/1990144241 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ccc00640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25c81401b0 0x7f25c816acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25cd600640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25c80b1440 0x7f25c813e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 -- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25c80b1440 msgr2=0x7f25c813e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25c80b1440 0x7f25c813e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 -- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25c81401b0 msgr2=0x7f25c816acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25c81401b0 0x7f25c816acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ce000640 1 -- 172.21.15.149:0/1990144241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4009390 con 0x7f25c8140580 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25cd600640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25c80b1440 0x7f25c813e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.337+0000 7f25ccc00640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25c81401b0 0x7f25c816acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.338+0000 7f25ce000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 0x7f25c815ce20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b7f0 tx=0x7f25c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.338+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000c490 con 0x7f25c8140580 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.338+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000c5f0 con 0x7f25c8140580 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.338+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000c9b0 con 0x7f25c8140580 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.338+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c80a70e0 con 0x7f25c8140580 2024-08-17T02:47:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.338+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c80abb80 con 0x7f25c8140580 2024-08-17T02:47:18.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.339+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c8064db0 con 0x7f25c8140580 2024-08-17T02:47:18.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.340+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f25c0012070 con 0x7f25c8140580 2024-08-17T02:47:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.341+0000 7f25c4c00640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f25a8065150 0x7f25a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.341+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25c0081f70 con 0x7f25c8140580 2024-08-17T02:47:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.341+0000 7f25cd600640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f25a8065150 0x7f25a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.342+0000 7f25cd600640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f25a8065150 0x7f25a8067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25bc001840 tx=0x7f25bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.345+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f25c004ff90 con 0x7f25c8140580 2024-08-17T02:47:18.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.518+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25c80ad6e0 con 0x7f25c8140580 2024-08-17T02:47:18.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.519+0000 7f25c4c00640 1 -- 172.21.15.149:0/1990144241 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f25c001a020 con 0x7f25c8140580 2024-08-17T02:47:18.519 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:18.520 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f25a8065150 msgr2=0x7f25a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f25a8065150 0x7f25a8067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25bc001840 tx=0x7f25bc009040 comp rx=0 tx=0).stop 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 msgr2=0x7f25c815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 0x7f25c815ce20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b7f0 tx=0x7f25c0009840 comp rx=0 tx=0).stop 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 shutdown_connections 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f25a8065150 0x7f25a8067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c8140580 0x7f25c815ce20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25c81401b0 0x7f25c816acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 --2- 172.21.15.149:0/1990144241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25c80b1440 0x7f25c813e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 >> 172.21.15.149:0/1990144241 conn(0x7f25c80cb9b0 msgr2=0x7f25c813f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:18.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 shutdown_connections 2024-08-17T02:47:18.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.521+0000 7f25d0000640 1 -- 172.21.15.149:0/1990144241 wait complete. 2024-08-17T02:47:18.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:18.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:18.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.689+0000 7f5cd7e00640 1 Processor -- start 2024-08-17T02:47:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.689+0000 7f5cd7e00640 1 -- start start 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5cd80cc8d0 0x7f5cd80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd80ce5c0 0x7f5cd80b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd7e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd80ceeb0 con 0x7f5cd8158e50 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd7e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80cf190 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80cf470 con 0x7f5cd80ce5c0 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5cd80cc8d0 0x7f5cd80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5cd80cc8d0 0x7f5cd80ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49892/0 (socket says 172.21.15.149:49892) 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd6000640 1 -- 172.21.15.149:0/1613799502 learned_addr learned my addr 172.21.15.149:0/1613799502 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.690+0000 7f5cd6a00640 1 --1- 172.21.15.149:0/1613799502 >> v1:172.21.15.149:6789/0 conn(0x7f5cd8158e50 0x7f5cd80cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45150/0 (socket says 172.21.15.149:45150) 2024-08-17T02:47:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.691+0000 7f5cd7400640 1 --2- 172.21.15.149:0/1613799502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd80ce5c0 0x7f5cd80b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.691+0000 7f5cd6000640 1 -- 172.21.15.149:0/1613799502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd80ce5c0 msgr2=0x7f5cd80b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.691+0000 7f5cd6000640 1 --2- 172.21.15.149:0/1613799502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd80ce5c0 0x7f5cd80b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.691+0000 7f5cd6000640 1 -- 172.21.15.149:0/1613799502 >> v1:172.21.15.149:6789/0 conn(0x7f5cd8158e50 legacy=0x7f5cd80cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.691+0000 7f5cd6000640 1 -- 172.21.15.149:0/1613799502 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd80b2a00 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.691+0000 7f5cd5600640 1 -- 172.21.15.149:0/1613799502 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624234647 0 0) 0x7f5cd80ceeb0 con 0x7f5cd8158e50 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.692+0000 7f5cd6000640 1 --2- 172.21.15.149:0/1613799502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd80ce080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009910 tx=0x7f5cc40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e1da383bf77919 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.692+0000 7f5cd5600640 1 -- 172.21.15.149:0/1613799502 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc402ae40 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.692+0000 7f5cd5600640 1 -- 172.21.15.149:0/1613799502 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4032440 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.692+0000 7f5cd5600640 1 -- 172.21.15.149:0/1613799502 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40327e0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 -- 172.21.15.149:0/1613799502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 msgr2=0x7f5cd80ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/1613799502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd80ce080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009910 tx=0x7f5cc40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 -- 172.21.15.149:0/1613799502 shutdown_connections 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/1613799502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd80ce5c0 0x7f5cd80b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/1613799502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd80ce080 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 -- 172.21.15.149:0/1613799502 >> 172.21.15.149:0/1613799502 conn(0x7f5cd8098de0 msgr2=0x7f5cd806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 -- 172.21.15.149:0/1613799502 shutdown_connections 2024-08-17T02:47:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.693+0000 7f5cd7e00640 1 -- 172.21.15.149:0/1613799502 wait complete. 2024-08-17T02:47:18.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.694+0000 7f5cd7e00640 1 Processor -- start 2024-08-17T02:47:18.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.694+0000 7f5cd7e00640 1 -- start start 2024-08-17T02:47:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cd80ce5c0 0x7f5cd80c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd8158e50 0x7f5cd8169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80c98f0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd81697c0 con 0x7f5cd80ce5c0 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80c4e40 con 0x7f5cd8158e50 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd81565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49896/0 (socket says 172.21.15.149:49896) 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.695+0000 7f5cd6a00640 1 -- 172.21.15.149:0/2622230076 learned_addr learned my addr 172.21.15.149:0/2622230076 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6000640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cd80ce5c0 0x7f5cd80c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd7400640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd8158e50 0x7f5cd8169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6a00640 1 -- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd8158e50 msgr2=0x7f5cd8169c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6a00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd8158e50 0x7f5cd8169c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6a00640 1 -- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cd80ce5c0 msgr2=0x7f5cd80c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6a00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cd80ce5c0 0x7f5cd80c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6a00640 1 -- 172.21.15.149:0/2622230076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009450 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd7400640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd8158e50 0x7f5cd8169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd6a00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd81565b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800c4f0 tx=0x7f5cc8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80072e0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8007460 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80057d0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.696+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd80c5120 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.697+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd81690c0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.698+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd8071050 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.698+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5cc8005bc0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.699+0000 7f5cce000640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cb8065180 0x7f5cb8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.699+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5cc8081760 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.699+0000 7f5cd6000640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cb8065180 0x7f5cb8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.700+0000 7f5cd6000640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cb8065180 0x7f5cb8067630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4034000 tx=0x7f5cc4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:18.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.703+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5cc804f8d0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.874 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.874+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cd8064610 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.874+0000 7f5cce000640 1 -- 172.21.15.149:0/2622230076 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cc80170a0 con 0x7f5cd80cc8d0 2024-08-17T02:47:18.879 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:18.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cb8065180 msgr2=0x7f5cb8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cb8065180 0x7f5cb8067630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4034000 tx=0x7f5cc4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 msgr2=0x7f5cd81565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd81565b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800c4f0 tx=0x7f5cc8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 shutdown_connections 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cb8065180 0x7f5cb8067630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cd8158e50 0x7f5cd8169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cd80ce5c0 0x7f5cd80c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 --2- 172.21.15.149:0/2622230076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cd80cc8d0 0x7f5cd81565b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 >> 172.21.15.149:0/2622230076 conn(0x7f5cd8098de0 msgr2=0x7f5cd8158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:18.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 shutdown_connections 2024-08-17T02:47:18.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:18.876+0000 7f5cd7e00640 1 -- 172.21.15.149:0/2622230076 wait complete. 2024-08-17T02:47:18.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:19.043 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.042+0000 7fe7a0000640 1 Processor -- start 2024-08-17T02:47:19.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.043+0000 7fe7a0000640 1 -- start start 2024-08-17T02:47:19.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe7a0000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe79806a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe7a0000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7981590b0 0x7fe7980c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe7a0000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7980c9110 0x7fe79815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe7a0000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980c95b0 con 0x7fe7980c9110 2024-08-17T02:47:19.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe7a0000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79806d790 con 0x7fe7981590b0 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe7a0000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79806a730 con 0x7fe798158ce0 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe79e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7980c9110 0x7fe79815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe79e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7980c9110 0x7fe79815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49910/0 (socket says 172.21.15.149:49910) 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.044+0000 7fe79e000640 1 -- 172.21.15.149:0/296104118 learned_addr learned my addr 172.21.15.149:0/296104118 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79cc00640 1 --2- 172.21.15.149:0/296104118 >> v2:172.21.15.161:3300/0 conn(0x7fe7981590b0 0x7fe7980c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79d600640 1 --2- 172.21.15.149:0/296104118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe79806a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79e000640 1 -- 172.21.15.149:0/296104118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 msgr2=0x7fe79806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79e000640 1 --2- 172.21.15.149:0/296104118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe79806a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79e000640 1 -- 172.21.15.149:0/296104118 >> v2:172.21.15.161:3300/0 conn(0x7fe7981590b0 msgr2=0x7fe7980c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79e000640 1 --2- 172.21.15.149:0/296104118 >> v2:172.21.15.161:3300/0 conn(0x7fe7981590b0 0x7fe7980c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.045+0000 7fe79e000640 1 -- 172.21.15.149:0/296104118 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79806cb80 con 0x7fe7980c9110 2024-08-17T02:47:19.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.046+0000 7fe79e000640 1 --2- 172.21.15.149:0/296104118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe79815c9e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe798068570 tx=0x7fe790009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4c66ec10c332c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.046+0000 7fe797e00640 1 -- 172.21.15.149:0/296104118 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790031400 con 0x7fe7980c9110 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.046+0000 7fe797e00640 1 -- 172.21.15.149:0/296104118 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79002d050 con 0x7fe7980c9110 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.046+0000 7fe797e00640 1 -- 172.21.15.149:0/296104118 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900317d0 con 0x7fe7980c9110 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.046+0000 7fe7a0000640 1 -- 172.21.15.149:0/296104118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 msgr2=0x7fe79815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.046+0000 7fe7a0000640 1 --2- 172.21.15.149:0/296104118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe79815c9e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe798068570 tx=0x7fe790009840 comp rx=0 tx=0).stop 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 -- 172.21.15.149:0/296104118 shutdown_connections 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 --2- 172.21.15.149:0/296104118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe79815c9e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 --2- 172.21.15.149:0/296104118 >> v2:172.21.15.161:3300/0 conn(0x7fe7981590b0 0x7fe7980c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 --2- 172.21.15.149:0/296104118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe79806a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 -- 172.21.15.149:0/296104118 >> 172.21.15.149:0/296104118 conn(0x7fe798067750 msgr2=0x7fe7980c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 -- 172.21.15.149:0/296104118 shutdown_connections 2024-08-17T02:47:19.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.047+0000 7fe7a0000640 1 -- 172.21.15.149:0/296104118 wait complete. 2024-08-17T02:47:19.049 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.048+0000 7fe7a0000640 1 Processor -- start 2024-08-17T02:47:19.049 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.048+0000 7fe7a0000640 1 -- start start 2024-08-17T02:47:19.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe7a0000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe7980ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe7a0000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe7981483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe7a0000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7981590b0 0x7fe798069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe7a0000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79816c080 con 0x7fe7980c9110 2024-08-17T02:47:19.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe7a0000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79816cea0 con 0x7fe7981590b0 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe7a0000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79816c290 con 0x7fe798158ce0 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe79d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe7980ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe79d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe7980ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49922/0 (socket says 172.21.15.149:49922) 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe79d600640 1 -- 172.21.15.149:0/4189814064 learned_addr learned my addr 172.21.15.149:0/4189814064 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe79cc00640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe7981483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.049+0000 7fe79e000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7981590b0 0x7fe798069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79d600640 1 -- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 msgr2=0x7fe7981483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79d600640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe7981483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79d600640 1 -- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7981590b0 msgr2=0x7fe798069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79d600640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7981590b0 0x7fe798069310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79d600640 1 -- 172.21.15.149:0/4189814064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790009ae0 con 0x7fe7980c9110 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79cc00640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe7981483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe79d600640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe7980ac660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00d890 tx=0x7fe78c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00de20 con 0x7fe7980c9110 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00b8d0 con 0x7fe7980c9110 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00bc70 con 0x7fe7980c9110 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.050+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79816c570 con 0x7fe7980c9110 2024-08-17T02:47:19.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.051+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79816cb30 con 0x7fe7980c9110 2024-08-17T02:47:19.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.052+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe798156e40 con 0x7fe7980c9110 2024-08-17T02:47:19.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.052+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe78c014640 con 0x7fe7980c9110 2024-08-17T02:47:19.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.053+0000 7fe794c00640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe778065150 0x7fe778067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.053+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe78c082ab0 con 0x7fe7980c9110 2024-08-17T02:47:19.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.053+0000 7fe79cc00640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe778065150 0x7fe778067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.054+0000 7fe79cc00640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe778065150 0x7fe778067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe79816bfe0 tx=0x7fe784008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.057+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe78c050b90 con 0x7fe7980c9110 2024-08-17T02:47:19.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.232+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe798071050 con 0x7fe7980c9110 2024-08-17T02:47:19.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.232+0000 7fe794c00640 1 -- 172.21.15.149:0/4189814064 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe78c0541b0 con 0x7fe7980c9110 2024-08-17T02:47:19.233 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe778065150 msgr2=0x7fe778067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe778065150 0x7fe778067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe79816bfe0 tx=0x7fe784008040 comp rx=0 tx=0).stop 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 msgr2=0x7fe7980ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe7980ac660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00d890 tx=0x7fe78c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 shutdown_connections 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe778065150 0x7fe778067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7981590b0 0x7fe798069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe798158ce0 0x7fe7981483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 --2- 172.21.15.149:0/4189814064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7980c9110 0x7fe7980ac660 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 >> 172.21.15.149:0/4189814064 conn(0x7fe798067750 msgr2=0x7fe7980aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 shutdown_connections 2024-08-17T02:47:19.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.234+0000 7fe7a0000640 1 -- 172.21.15.149:0/4189814064 wait complete. 2024-08-17T02:47:19.251 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:19.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.403+0000 7fb199000640 1 Processor -- start 2024-08-17T02:47:19.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.403+0000 7fb199000640 1 -- start start 2024-08-17T02:47:19.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.404+0000 7fb199000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb194158e20 0x7fb1940ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.404+0000 7fb199000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940cb540 con 0x7fb1940c3390 2024-08-17T02:47:19.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.404+0000 7fb199000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940ce6c0 con 0x7fb194088f20 2024-08-17T02:47:19.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.404+0000 7fb199000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940cf7f0 con 0x7fb194158e20 2024-08-17T02:47:19.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb191400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb1940c3390 0x7fb1940cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45158/0 (socket says 172.21.15.149:45158) 2024-08-17T02:47:19.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb191400640 1 -- 172.21.15.149:0/2754000216 learned_addr learned my addr 172.21.15.149:0/2754000216 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:19.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb191e00640 1 --2- 172.21.15.149:0/2754000216 >> v2:172.21.15.161:3300/0 conn(0x7fb194158e20 0x7fb1940ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb190a00640 1 -- 172.21.15.149:0/2754000216 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175182622 0 0) 0x7fb1940cb540 con 0x7fb1940c3390 2024-08-17T02:47:19.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb190a00640 1 -- 172.21.15.149:0/2754000216 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1780034e0 con 0x7fb1940c3390 2024-08-17T02:47:19.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb191e00640 1 -- 172.21.15.149:0/2754000216 >> v1:172.21.15.161:6789/0 conn(0x7fb194088f20 legacy=0x7fb1940cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb191e00640 1 -- 172.21.15.149:0/2754000216 >> v1:172.21.15.149:6789/0 conn(0x7fb1940c3390 legacy=0x7fb1940cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.405+0000 7fb191e00640 1 -- 172.21.15.149:0/2754000216 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940caef0 con 0x7fb194158e20 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.406+0000 7fb191e00640 1 --2- 172.21.15.149:0/2754000216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194158e20 0x7fb1940ca310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb184009850 tx=0x7fb1840090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05cdf7901364612 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.406+0000 7fb190a00640 1 -- 172.21.15.149:0/2754000216 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18402ae20 con 0x7fb194158e20 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb190a00640 1 -- 172.21.15.149:0/2754000216 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184032440 con 0x7fb194158e20 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb190a00640 1 -- 172.21.15.149:0/2754000216 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840327e0 con 0x7fb194158e20 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 -- 172.21.15.149:0/2754000216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194158e20 msgr2=0x7fb1940ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 --2- 172.21.15.149:0/2754000216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194158e20 0x7fb1940ca310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb184009850 tx=0x7fb1840090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 -- 172.21.15.149:0/2754000216 shutdown_connections 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 --2- 172.21.15.149:0/2754000216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194158e20 0x7fb1940ca310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 -- 172.21.15.149:0/2754000216 >> 172.21.15.149:0/2754000216 conn(0x7fb1940cfd70 msgr2=0x7fb1940d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 -- 172.21.15.149:0/2754000216 shutdown_connections 2024-08-17T02:47:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.407+0000 7fb199000640 1 -- 172.21.15.149:0/2754000216 wait complete. 2024-08-17T02:47:19.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.409+0000 7fb199000640 1 Processor -- start 2024-08-17T02:47:19.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.409+0000 7fb199000640 1 -- start start 2024-08-17T02:47:19.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.409+0000 7fb199000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194088f20 0x7fb1940b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb199000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1940c3390 0x7fb1941565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb199000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 0x7fb1940c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb199000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b3d50 con 0x7fb194158e20 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb199000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940c5f80 con 0x7fb194088f20 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb199000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b3140 con 0x7fb1940c3390 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 0x7fb1940c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 0x7fb1940c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49938/0 (socket says 172.21.15.149:49938) 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 -- 172.21.15.149:0/481492806 learned_addr learned my addr 172.21.15.149:0/481492806 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb191e00640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194088f20 0x7fb1940b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb191400640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1940c3390 0x7fb1941565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 -- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1940c3390 msgr2=0x7fb1941565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1940c3390 0x7fb1941565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 -- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194088f20 msgr2=0x7fb1940b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194088f20 0x7fb1940b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.410+0000 7fb192800640 1 -- 172.21.15.149:0/481492806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009390 con 0x7fb194158e20 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.411+0000 7fb192800640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 0x7fb1940c5a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c840 tx=0x7fb18c001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.411+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00ce30 con 0x7fb194158e20 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.411+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00a850 con 0x7fb194158e20 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.411+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940b3420 con 0x7fb194158e20 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.411+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00ac10 con 0x7fb194158e20 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.411+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940b39e0 con 0x7fb194158e20 2024-08-17T02:47:19.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.412+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1940b3f00 con 0x7fb194158e20 2024-08-17T02:47:19.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.413+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb18c01b450 con 0x7fb194158e20 2024-08-17T02:47:19.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.414+0000 7fb189600640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb174065150 0x7fb174067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.415+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb18c082680 con 0x7fb194158e20 2024-08-17T02:47:19.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.415+0000 7fb191e00640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb174065150 0x7fb174067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.415+0000 7fb191e00640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb174065150 0x7fb174067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb184034000 tx=0x7fb184032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.418+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb1940b3f00 con 0x7fb194158e20 2024-08-17T02:47:19.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.590+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb194071050 con 0x7fb194158e20 2024-08-17T02:47:19.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.590+0000 7fb189600640 1 -- 172.21.15.149:0/481492806 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb18c0506a0 con 0x7fb194158e20 2024-08-17T02:47:19.591 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:19.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb174065150 msgr2=0x7fb174067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb174065150 0x7fb174067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb184034000 tx=0x7fb184032000 comp rx=0 tx=0).stop 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 msgr2=0x7fb1940c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 0x7fb1940c5a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c840 tx=0x7fb18c001660 comp rx=0 tx=0).stop 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 shutdown_connections 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb174065150 0x7fb174067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb194158e20 0x7fb1940c5a40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1940c3390 0x7fb1941565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 --2- 172.21.15.149:0/481492806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb194088f20 0x7fb1940b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 >> 172.21.15.149:0/481492806 conn(0x7fb1940cfd70 msgr2=0x7fb194067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 shutdown_connections 2024-08-17T02:47:19.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.593+0000 7fb199000640 1 -- 172.21.15.149:0/481492806 wait complete. 2024-08-17T02:47:19.682 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:47:19.682 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:47:19.682 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:19.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.830+0000 7fc7ba000640 1 Processor -- start 2024-08-17T02:47:19.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.830+0000 7fc7ba000640 1 -- start start 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.831+0000 7fc7ba000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7b4158d60 0x7fc7b40b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.831+0000 7fc7ba000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b40b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.831+0000 7fc7ba000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40b18d0 con 0x7fc7b415cb30 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.831+0000 7fc7ba000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40b0d00 con 0x7fc7b4158d60 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.831+0000 7fc7ba000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40b0fa0 con 0x7fc7b40c7420 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7b4158d60 0x7fc7b40b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7b4158d60 0x7fc7b40b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49954/0 (socket says 172.21.15.149:49954) 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 -- 172.21.15.149:0/3295616749 learned_addr learned my addr 172.21.15.149:0/3295616749 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3e00640 1 --2- 172.21.15.149:0/3295616749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b40b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 -- 172.21.15.149:0/3295616749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 msgr2=0x7fc7b40b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:19.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 --2- 172.21.15.149:0/3295616749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b40b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 -- 172.21.15.149:0/3295616749 >> v1:172.21.15.149:6789/0 conn(0x7fc7b415cb30 legacy=0x7fc7b40c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b2000640 1 -- 172.21.15.149:0/3295616749 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380905758 0 0) 0x7fc7b40b18d0 con 0x7fc7b415cb30 2024-08-17T02:47:19.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.832+0000 7fc7b3400640 1 -- 172.21.15.149:0/3295616749 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40b1280 con 0x7fc7b4158d60 2024-08-17T02:47:19.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.833+0000 7fc7b3400640 1 --2- 172.21.15.149:0/3295616749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b4158d60 0x7fc7b40b1d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009940 tx=0x7fc7a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3d2e3ad85af00b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.833+0000 7fc7b2000640 1 -- 172.21.15.149:0/3295616749 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a402ae40 con 0x7fc7b4158d60 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.833+0000 7fc7b2000640 1 -- 172.21.15.149:0/3295616749 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4032440 con 0x7fc7b4158d60 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.833+0000 7fc7b2000640 1 -- 172.21.15.149:0/3295616749 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40327e0 con 0x7fc7b4158d60 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 -- 172.21.15.149:0/3295616749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b4158d60 msgr2=0x7fc7b40b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 --2- 172.21.15.149:0/3295616749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b4158d60 0x7fc7b40b1d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009940 tx=0x7fc7a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 -- 172.21.15.149:0/3295616749 shutdown_connections 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 --2- 172.21.15.149:0/3295616749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b40b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 --2- 172.21.15.149:0/3295616749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b4158d60 0x7fc7b40b1d60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 -- 172.21.15.149:0/3295616749 >> 172.21.15.149:0/3295616749 conn(0x7fc7b40b3040 msgr2=0x7fc7b40b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 -- 172.21.15.149:0/3295616749 shutdown_connections 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.834+0000 7fc7ba000640 1 -- 172.21.15.149:0/3295616749 wait complete. 2024-08-17T02:47:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.836+0000 7fc7ba000640 1 Processor -- start 2024-08-17T02:47:19.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.836+0000 7fc7ba000640 1 -- start start 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7ba000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7ba000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4158d60 0x7fc7b4152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7ba000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 0x7fc7b416c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7ba000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4098000 con 0x7fc7b415cb30 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7ba000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4097a20 con 0x7fc7b4158d60 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7ba000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b415a8b0 con 0x7fc7b40c7420 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 0x7fc7b416c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 0x7fc7b416c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49970/0 (socket says 172.21.15.149:49970) 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 -- 172.21.15.149:0/1891972701 learned_addr learned my addr 172.21.15.149:0/1891972701 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:19.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3400640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b2a00640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4158d60 0x7fc7b4152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 -- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 msgr2=0x7fc7b415bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b415bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 -- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4158d60 msgr2=0x7fc7b4152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4158d60 0x7fc7b4152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.837+0000 7fc7b3e00640 1 -- 172.21.15.149:0/1891972701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009450 con 0x7fc7b415cb30 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.838+0000 7fc7b3e00640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 0x7fc7b416c7f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009f20 tx=0x7fc7ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.838+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00ce10 con 0x7fc7b415cb30 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.838+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac00f040 con 0x7fc7b415cb30 2024-08-17T02:47:19.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.838+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b4097c90 con 0x7fc7b415cb30 2024-08-17T02:47:19.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.838+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0146d0 con 0x7fc7b415cb30 2024-08-17T02:47:19.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.838+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4152b60 con 0x7fc7b415cb30 2024-08-17T02:47:19.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.839+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b4152de0 con 0x7fc7b415cb30 2024-08-17T02:47:19.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.840+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc7ac014a80 con 0x7fc7b415cb30 2024-08-17T02:47:19.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.841+0000 7fc7aaa00640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc794065150 0x7fc794067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.841+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7ac083260 con 0x7fc7b415cb30 2024-08-17T02:47:19.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.841+0000 7fc7b3400640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc794065150 0x7fc794067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.842+0000 7fc7b3400640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc794065150 0x7fc794067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4034000 tx=0x7fc7a4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:19.845+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc7b4152de0 con 0x7fc7b415cb30 2024-08-17T02:47:20.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.018+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b4152de0 con 0x7fc7b415cb30 2024-08-17T02:47:20.020 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.019+0000 7fc7aaa00640 1 -- 172.21.15.149:0/1891972701 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fc7b4152de0 con 0x7fc7b415cb30 2024-08-17T02:47:20.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:20.020 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:20.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc794065150 msgr2=0x7fc794067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc794065150 0x7fc794067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4034000 tx=0x7fc7a4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:20.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 msgr2=0x7fc7b416c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 0x7fc7b416c7f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009f20 tx=0x7fc7ac00b040 comp rx=0 tx=0).stop 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 shutdown_connections 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc794065150 0x7fc794067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b415cb30 0x7fc7b416c7f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4158d60 0x7fc7b4152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 --2- 172.21.15.149:0/1891972701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b40c7420 0x7fc7b415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.021+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 >> 172.21.15.149:0/1891972701 conn(0x7fc7b40b3040 msgr2=0x7fc7b415cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.022+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 shutdown_connections 2024-08-17T02:47:20.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.022+0000 7fc7ba000640 1 -- 172.21.15.149:0/1891972701 wait complete. 2024-08-17T02:47:20.039 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:20.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:20.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.192+0000 7f7529800640 1 Processor -- start 2024-08-17T02:47:20.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.192+0000 7f7529800640 1 -- start start 2024-08-17T02:47:20.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f7529800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7524157e10 0x7f75240b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f7529800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7524157070 con 0x7f75240adec0 2024-08-17T02:47:20.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f7529800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752415b410 con 0x7f75240b0a80 2024-08-17T02:47:20.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f7529800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240b1390 con 0x7f7524157e10 2024-08-17T02:47:20.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f7523400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f75240adec0 0x7f752415a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45178/0 (socket says 172.21.15.149:45178) 2024-08-17T02:47:20.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f7523400640 1 -- 172.21.15.149:0/2368281676 learned_addr learned my addr 172.21.15.149:0/2368281676 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.193+0000 7f751a000640 1 --2- 172.21.15.149:0/2368281676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7524157e10 0x7f75240b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.194+0000 7f7522000640 1 -- 172.21.15.149:0/2368281676 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118582378 0 0) 0x7f7524157070 con 0x7f75240adec0 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.194+0000 7f7522000640 1 -- 172.21.15.149:0/2368281676 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75080034e0 con 0x7f75240adec0 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.194+0000 7f751a000640 1 -- 172.21.15.149:0/2368281676 >> v1:172.21.15.161:6789/0 conn(0x7f75240b0a80 legacy=0x7f75240ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.194+0000 7f751a000640 1 -- 172.21.15.149:0/2368281676 >> v1:172.21.15.149:6789/0 conn(0x7f75240adec0 legacy=0x7f752415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.194+0000 7f7522000640 1 -- 172.21.15.149:0/2368281676 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 938642550 0 0) 0x7f75080034e0 con 0x7f75240adec0 2024-08-17T02:47:20.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.194+0000 7f751a000640 1 -- 172.21.15.149:0/2368281676 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524157330 con 0x7f7524157e10 2024-08-17T02:47:20.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.195+0000 7f751a000640 1 --2- 172.21.15.149:0/2368281676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7524157e10 0x7f75240b0e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f750c009880 tx=0x7f750c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb654628fe599b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.195+0000 7f7522000640 1 -- 172.21.15.149:0/2368281676 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0017f0 con 0x7f7524157e10 2024-08-17T02:47:20.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.195+0000 7f7522000640 1 -- 172.21.15.149:0/2368281676 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c02aa30 con 0x7f7524157e10 2024-08-17T02:47:20.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.195+0000 7f7522000640 1 -- 172.21.15.149:0/2368281676 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c02adb0 con 0x7f7524157e10 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 -- 172.21.15.149:0/2368281676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7524157e10 msgr2=0x7f75240b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 --2- 172.21.15.149:0/2368281676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7524157e10 0x7f75240b0e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f750c009880 tx=0x7f750c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 -- 172.21.15.149:0/2368281676 shutdown_connections 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 --2- 172.21.15.149:0/2368281676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7524157e10 0x7f75240b0e50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 -- 172.21.15.149:0/2368281676 >> 172.21.15.149:0/2368281676 conn(0x7f7524067750 msgr2=0x7f75240cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 -- 172.21.15.149:0/2368281676 shutdown_connections 2024-08-17T02:47:20.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.196+0000 7f7529800640 1 -- 172.21.15.149:0/2368281676 wait complete. 2024-08-17T02:47:20.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.198+0000 7f7529800640 1 Processor -- start 2024-08-17T02:47:20.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.198+0000 7f7529800640 1 -- start start 2024-08-17T02:47:20.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7529800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75240adec0 0x7f7524145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7529800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75240b0a80 0x7f752415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7529800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 0x7f752406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7529800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524148240 con 0x7f7524157e10 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7529800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524145d70 con 0x7f75240b0a80 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7529800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752415ce60 con 0x7f75240adec0 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 0x7f752406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 0x7f752406c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49972/0 (socket says 172.21.15.149:49972) 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 -- 172.21.15.149:0/1870130874 learned_addr learned my addr 172.21.15.149:0/1870130874 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f751a000640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75240b0a80 0x7f752415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7522a00640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75240adec0 0x7f7524145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 -- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75240adec0 msgr2=0x7f7524145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75240adec0 0x7f7524145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 -- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75240b0a80 msgr2=0x7f752415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75240b0a80 0x7f752415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.199+0000 7f7523400640 1 -- 172.21.15.149:0/1870130874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009390 con 0x7f7524157e10 2024-08-17T02:47:20.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.200+0000 7f7523400640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 0x7f752406c780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f751c00cb60 tx=0x7f751c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.200+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c004d30 con 0x7f7524157e10 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.200+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c004e90 con 0x7f7524157e10 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.200+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00aa00 con 0x7f7524157e10 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.200+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7524147910 con 0x7f7524157e10 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.200+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524147ed0 con 0x7f7524157e10 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.201+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75241483b0 con 0x7f7524157e10 2024-08-17T02:47:20.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.202+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f751c007150 con 0x7f7524157e10 2024-08-17T02:47:20.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.202+0000 7f751aa00640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7500065150 0x7f7500067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.203+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f751c081fc0 con 0x7f7524157e10 2024-08-17T02:47:20.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.203+0000 7f7522a00640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7500065150 0x7f7500067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.203+0000 7f7522a00640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7500065150 0x7f7500067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75140037e0 tx=0x7f7514009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.206+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f751c050060 con 0x7f7524157e10 2024-08-17T02:47:20.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.381+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7524064db0 con 0x7f7524157e10 2024-08-17T02:47:20.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.381+0000 7f751aa00640 1 -- 172.21.15.149:0/1870130874 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f751c0180a0 con 0x7f7524157e10 2024-08-17T02:47:20.382 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.383+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7500065150 msgr2=0x7f7500067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.383+0000 7f7529800640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7500065150 0x7f7500067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75140037e0 tx=0x7f7514009040 comp rx=0 tx=0).stop 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.383+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 msgr2=0x7f752406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.383+0000 7f7529800640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 0x7f752406c780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f751c00cb60 tx=0x7f751c007c90 comp rx=0 tx=0).stop 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 shutdown_connections 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7500065150 0x7f7500067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7524157e10 0x7f752406c780 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75240b0a80 0x7f752415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 --2- 172.21.15.149:0/1870130874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75240adec0 0x7f7524145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 >> 172.21.15.149:0/1870130874 conn(0x7f7524067750 msgr2=0x7f75240cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 shutdown_connections 2024-08-17T02:47:20.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.384+0000 7f7529800640 1 -- 172.21.15.149:0/1870130874 wait complete. 2024-08-17T02:47:20.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:20.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.551+0000 7fa19d000640 1 Processor -- start 2024-08-17T02:47:20.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.551+0000 7fa19d000640 1 -- start start 2024-08-17T02:47:20.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa19d000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1980caa80 0x7fa19806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa19d000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa198156e60 con 0x7fa1980ad3e0 2024-08-17T02:47:20.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa19d000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980c95e0 con 0x7fa1980abef0 2024-08-17T02:47:20.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa19d000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1980ac2c0 con 0x7fa1980caa80 2024-08-17T02:47:20.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa197e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1980caa80 0x7fa19806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa18ea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa1980ad3e0 0x7fa19806d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45192/0 (socket says 172.21.15.149:45192) 2024-08-17T02:47:20.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.552+0000 7fa18ea00640 1 -- 172.21.15.149:0/899231781 learned_addr learned my addr 172.21.15.149:0/899231781 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:20.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.553+0000 7fa197e00640 1 -- 172.21.15.149:0/899231781 >> v1:172.21.15.161:6789/0 conn(0x7fa1980abef0 legacy=0x7fa1980accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:20.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.553+0000 7fa197e00640 1 -- 172.21.15.149:0/899231781 >> v1:172.21.15.149:6789/0 conn(0x7fa1980ad3e0 legacy=0x7fa19806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.553+0000 7fa197e00640 1 -- 172.21.15.149:0/899231781 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19806e100 con 0x7fa1980caa80 2024-08-17T02:47:20.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.554+0000 7fa197e00640 1 --2- 172.21.15.149:0/899231781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980caa80 0x7fa19806db00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e60 tx=0x7fa190009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a78fd0df09ed8b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.554+0000 7fa196a00640 1 -- 172.21.15.149:0/899231781 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190007550 con 0x7fa1980caa80 2024-08-17T02:47:20.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.554+0000 7fa196a00640 1 -- 172.21.15.149:0/899231781 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19002d050 con 0x7fa1980caa80 2024-08-17T02:47:20.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.554+0000 7fa196a00640 1 -- 172.21.15.149:0/899231781 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190007920 con 0x7fa1980caa80 2024-08-17T02:47:20.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.554+0000 7fa19d000640 1 -- 172.21.15.149:0/899231781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980caa80 msgr2=0x7fa19806db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.554+0000 7fa19d000640 1 --2- 172.21.15.149:0/899231781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980caa80 0x7fa19806db00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e60 tx=0x7fa190009780 comp rx=0 tx=0).stop 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.555+0000 7fa19d000640 1 -- 172.21.15.149:0/899231781 shutdown_connections 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.555+0000 7fa19d000640 1 --2- 172.21.15.149:0/899231781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980caa80 0x7fa19806db00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.555+0000 7fa19d000640 1 -- 172.21.15.149:0/899231781 >> 172.21.15.149:0/899231781 conn(0x7fa198066cd0 msgr2=0x7fa1980670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.555+0000 7fa19d000640 1 -- 172.21.15.149:0/899231781 shutdown_connections 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.555+0000 7fa19d000640 1 -- 172.21.15.149:0/899231781 wait complete. 2024-08-17T02:47:20.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.556+0000 7fa19d000640 1 Processor -- start 2024-08-17T02:47:20.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.556+0000 7fa19d000640 1 -- start start 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa19d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 0x7fa1981698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa19d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1980ad3e0 0x7fa198154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa19d000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980caa80 0x7fa1980c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa19d000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980c2920 con 0x7fa1980abef0 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa19d000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa198169e30 con 0x7fa1980ad3e0 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa19d000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980c0bd0 con 0x7fa1980caa80 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa197400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 0x7fa1981698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa197400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 0x7fa1981698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49982/0 (socket says 172.21.15.149:49982) 2024-08-17T02:47:20.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa197400640 1 -- 172.21.15.149:0/1484040669 learned_addr learned my addr 172.21.15.149:0/1484040669 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa18ea00640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1980ad3e0 0x7fa198154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.557+0000 7fa197e00640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980caa80 0x7fa1980c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa197400640 1 -- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980caa80 msgr2=0x7fa1980c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa197400640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980caa80 0x7fa1980c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa197400640 1 -- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1980ad3e0 msgr2=0x7fa198154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa197400640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1980ad3e0 0x7fa198154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa197400640 1 -- 172.21.15.149:0/1484040669 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190009a20 con 0x7fa1980abef0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa197400640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 0x7fa1981698f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c5e0 tx=0x7fa188007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188012630 con 0x7fa1980abef0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880127b0 con 0x7fa1980abef0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188012bb0 con 0x7fa1980abef0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1980c0eb0 con 0x7fa1980abef0 2024-08-17T02:47:20.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.558+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1980c1470 con 0x7fa1980abef0 2024-08-17T02:47:20.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.559+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa198071050 con 0x7fa1980abef0 2024-08-17T02:47:20.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.560+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa18801a3b0 con 0x7fa1980abef0 2024-08-17T02:47:20.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.561+0000 7fa18f400640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa174065150 0x7fa174067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.561+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa188081ff0 con 0x7fa1980abef0 2024-08-17T02:47:20.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.561+0000 7fa18ea00640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa174065150 0x7fa174067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.562+0000 7fa18ea00640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa174065150 0x7fa174067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa180007fd0 tx=0x7fa180009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.565+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa188050050 con 0x7fa1980abef0 2024-08-17T02:47:20.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.738+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1980ad950 con 0x7fa1980abef0 2024-08-17T02:47:20.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.738+0000 7fa18f400640 1 -- 172.21.15.149:0/1484040669 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa188053670 con 0x7fa1980abef0 2024-08-17T02:47:20.739 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:20.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa174065150 msgr2=0x7fa174067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa174065150 0x7fa174067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa180007fd0 tx=0x7fa180009040 comp rx=0 tx=0).stop 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 msgr2=0x7fa1981698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 0x7fa1981698f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c5e0 tx=0x7fa188007ed0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 shutdown_connections 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa174065150 0x7fa174067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980caa80 0x7fa1980c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1980ad3e0 0x7fa198154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 --2- 172.21.15.149:0/1484040669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1980abef0 0x7fa1981698f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 >> 172.21.15.149:0/1484040669 conn(0x7fa198066cd0 msgr2=0x7fa1980aab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 shutdown_connections 2024-08-17T02:47:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.741+0000 7fa19d000640 1 -- 172.21.15.149:0/1484040669 wait complete. 2024-08-17T02:47:20.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:20.910 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.910+0000 7fad7fe00640 1 Processor -- start 2024-08-17T02:47:20.910 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.910+0000 7fad7fe00640 1 -- start start 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad800abef0 0x7fad800accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad800ad210 0x7fad8006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7fe00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad80156e60 con 0x7fad8006d930 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad800c95e0 con 0x7fad800abef0 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7fe00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad800ad660 con 0x7fad800ad210 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad800abef0 0x7fad800accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad800abef0 0x7fad800accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49990/0 (socket says 172.21.15.149:49990) 2024-08-17T02:47:20.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.911+0000 7fad7ea00640 1 -- 172.21.15.149:0/1417709047 learned_addr learned my addr 172.21.15.149:0/1417709047 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:20.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.912+0000 7fad7ea00640 1 -- 172.21.15.149:0/1417709047 >> v2:172.21.15.161:3300/0 conn(0x7fad800ad210 msgr2=0x7fad8006d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:20.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.912+0000 7fad7ea00640 1 --2- 172.21.15.149:0/1417709047 >> v2:172.21.15.161:3300/0 conn(0x7fad800ad210 0x7fad8006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.912+0000 7fad7ea00640 1 -- 172.21.15.149:0/1417709047 >> v1:172.21.15.161:6789/0 conn(0x7fad8006d930 legacy=0x7fad8015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:20.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.912+0000 7fad7ea00640 1 -- 172.21.15.149:0/1417709047 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800ac2c0 con 0x7fad800abef0 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7ea00640 1 --2- 172.21.15.149:0/1417709047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800accd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad8006bfd0 tx=0x7fad700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c00fea49a9a7643 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7e000640 1 -- 172.21.15.149:0/1417709047 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7002ade0 con 0x7fad800abef0 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7e000640 1 -- 172.21.15.149:0/1417709047 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70032440 con 0x7fad800abef0 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7e000640 1 -- 172.21.15.149:0/1417709047 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70032820 con 0x7fad800abef0 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7fe00640 1 -- 172.21.15.149:0/1417709047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 msgr2=0x7fad800accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1417709047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800accd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad8006bfd0 tx=0x7fad700091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7fe00640 1 -- 172.21.15.149:0/1417709047 shutdown_connections 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1417709047 >> v2:172.21.15.161:3300/0 conn(0x7fad800ad210 0x7fad8006d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1417709047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800accd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.913+0000 7fad7fe00640 1 -- 172.21.15.149:0/1417709047 >> 172.21.15.149:0/1417709047 conn(0x7fad80066cd0 msgr2=0x7fad800670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.914+0000 7fad7fe00640 1 -- 172.21.15.149:0/1417709047 shutdown_connections 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.914+0000 7fad7fe00640 1 -- 172.21.15.149:0/1417709047 wait complete. 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.915+0000 7fad7fe00640 1 Processor -- start 2024-08-17T02:47:20.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.915+0000 7fad7fe00640 1 -- start start 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8006d930 0x7fad80158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad800ad210 0x7fad801440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad7fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad800a9970 con 0x7fad800abef0 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad7fe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad801591f0 con 0x7fad800ad210 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad7fe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8016d0a0 con 0x7fad8006d930 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad76000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad76000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50004/0 (socket says 172.21.15.149:50004) 2024-08-17T02:47:20.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.916+0000 7fad76000640 1 -- 172.21.15.149:0/1987689318 learned_addr learned my addr 172.21.15.149:0/1987689318 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:20.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad7ea00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8006d930 0x7fad80158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad7f400640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad800ad210 0x7fad801440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76000640 1 -- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8006d930 msgr2=0x7fad80158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76000640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8006d930 0x7fad80158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76000640 1 -- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad800ad210 msgr2=0x7fad801440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76000640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad800ad210 0x7fad801440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76000640 1 -- 172.21.15.149:0/1987689318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70009450 con 0x7fad800abef0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad7ea00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8006d930 0x7fad80158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad7f400640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad800ad210 0x7fad801440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76000640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800ab4a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b5e0 tx=0x7fad68009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800f590 con 0x7fad800abef0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6800f6f0 con 0x7fad800abef0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8016d380 con 0x7fad800abef0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.917+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800fab0 con 0x7fad800abef0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.918+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8016d940 con 0x7fad800abef0 2024-08-17T02:47:20.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.918+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad800a9b20 con 0x7fad800abef0 2024-08-17T02:47:20.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.919+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad6801a460 con 0x7fad800abef0 2024-08-17T02:47:20.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.920+0000 7fad76a00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fad5c065150 0x7fad5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.921+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad680821b0 con 0x7fad800abef0 2024-08-17T02:47:20.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.921+0000 7fad7ea00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fad5c065150 0x7fad5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.921+0000 7fad7ea00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fad5c065150 0x7fad5c067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad70034000 tx=0x7fad70032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:20.924+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad800a9b20 con 0x7fad800abef0 2024-08-17T02:47:21.103 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.102+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad80071050 con 0x7fad800abef0 2024-08-17T02:47:21.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.103+0000 7fad76a00640 1 -- 172.21.15.149:0/1987689318 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad68050250 con 0x7fad800abef0 2024-08-17T02:47:21.104 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:21.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fad5c065150 msgr2=0x7fad5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fad5c065150 0x7fad5c067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad70034000 tx=0x7fad70032000 comp rx=0 tx=0).stop 2024-08-17T02:47:21.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 msgr2=0x7fad800ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800ab4a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b5e0 tx=0x7fad68009120 comp rx=0 tx=0).stop 2024-08-17T02:47:21.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 shutdown_connections 2024-08-17T02:47:21.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fad5c065150 0x7fad5c067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad800ad210 0x7fad801440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad800abef0 0x7fad800ab4a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 --2- 172.21.15.149:0/1987689318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8006d930 0x7fad80158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 >> 172.21.15.149:0/1987689318 conn(0x7fad80066cd0 msgr2=0x7fad800caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:21.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 shutdown_connections 2024-08-17T02:47:21.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.105+0000 7fad7fe00640 1 -- 172.21.15.149:0/1987689318 wait complete. 2024-08-17T02:47:21.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:47:21.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.270+0000 7f5ce4200640 1 Processor -- start 2024-08-17T02:47:21.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.270+0000 7f5ce4200640 1 -- start start 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.271+0000 7f5ce4200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5cdc155a20 0x7f5cdc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.271+0000 7f5ce4200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5cdc155df0 0x7f5cdc0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.271+0000 7f5ce4200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc06d7f0 0x7f5cdc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.271+0000 7f5ce4200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b0350 con 0x7f5cdc155a20 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.271+0000 7f5ce4200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc156670 con 0x7f5cdc155df0 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.271+0000 7f5ce4200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc06e180 con 0x7f5cdc06d7f0 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5cdc155a20 0x7f5cdc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5cdc155a20 0x7f5cdc0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50010/0 (socket says 172.21.15.149:50010) 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 -- 172.21.15.149:0/3106564533 learned_addr learned my addr 172.21.15.149:0/3106564533 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 -- 172.21.15.149:0/3106564533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc06d7f0 msgr2=0x7f5cdc06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:21.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 --2- 172.21.15.149:0/3106564533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc06d7f0 0x7f5cdc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 -- 172.21.15.149:0/3106564533 >> v2:172.21.15.161:3300/0 conn(0x7f5cdc155df0 msgr2=0x7f5cdc0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 --2- 172.21.15.149:0/3106564533 >> v2:172.21.15.161:3300/0 conn(0x7f5cdc155df0 0x7f5cdc0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.272+0000 7f5ce1800640 1 -- 172.21.15.149:0/3106564533 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc06e5e0 con 0x7f5cdc155a20 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.273+0000 7f5ce1800640 1 --2- 172.21.15.149:0/3106564533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155a20 0x7f5cdc0adf10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc06aa10 tx=0x7f5cd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51912e395ea02363 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.273+0000 7f5cdbe00640 1 -- 172.21.15.149:0/3106564533 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0031510 con 0x7f5cdc155a20 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.273+0000 7f5cdbe00640 1 -- 172.21.15.149:0/3106564533 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd002f050 con 0x7f5cdc155a20 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.273+0000 7f5cdbe00640 1 -- 172.21.15.149:0/3106564533 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00318e0 con 0x7f5cdc155a20 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 -- 172.21.15.149:0/3106564533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155a20 msgr2=0x7f5cdc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3106564533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155a20 0x7f5cdc0adf10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc06aa10 tx=0x7f5cd00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 -- 172.21.15.149:0/3106564533 shutdown_connections 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3106564533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc06d7f0 0x7f5cdc06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3106564533 >> v2:172.21.15.161:3300/0 conn(0x7f5cdc155df0 0x7f5cdc0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3106564533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155a20 0x7f5cdc0adf10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 -- 172.21.15.149:0/3106564533 >> 172.21.15.149:0/3106564533 conn(0x7f5cdc0cb9b0 msgr2=0x7f5cdc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:21.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 -- 172.21.15.149:0/3106564533 shutdown_connections 2024-08-17T02:47:21.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.274+0000 7f5ce4200640 1 -- 172.21.15.149:0/3106564533 wait complete. 2024-08-17T02:47:21.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.276+0000 7f5ce4200640 1 Processor -- start 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.276+0000 7f5ce4200640 1 -- start start 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce4200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc06d7f0 0x7f5cdc0a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce4200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc155a20 0x7f5cdc0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce4200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 0x7f5cdc168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce4200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc169070 con 0x7f5cdc155df0 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce4200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc141ce0 con 0x7f5cdc06d7f0 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce4200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0aa1b0 con 0x7f5cdc155a20 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 0x7f5cdc168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 0x7f5cdc168200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50018/0 (socket says 172.21.15.149:50018) 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 -- 172.21.15.149:0/3458118620 learned_addr learned my addr 172.21.15.149:0/3458118620 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce1800640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc06d7f0 0x7f5cdc0a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce0e00640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc155a20 0x7f5cdc0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 -- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc155a20 msgr2=0x7f5cdc0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc155a20 0x7f5cdc0a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 -- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc06d7f0 msgr2=0x7f5cdc0a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc06d7f0 0x7f5cdc0a7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.277+0000 7f5ce2200640 1 -- 172.21.15.149:0/3458118620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0009450 con 0x7f5cdc155df0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.278+0000 7f5ce2200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 0x7f5cdc168200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400bc30 tx=0x7f5cd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.278+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40092e0 con 0x7f5cdc155df0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.278+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd400c860 con 0x7f5cdc155df0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.278+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc0a92c0 con 0x7f5cdc155df0 2024-08-17T02:47:21.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.278+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd400cc20 con 0x7f5cdc155df0 2024-08-17T02:47:21.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.278+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc0a9880 con 0x7f5cdc155df0 2024-08-17T02:47:21.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.279+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc064db0 con 0x7f5cdc155df0 2024-08-17T02:47:21.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.280+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5cd4012070 con 0x7f5cdc155df0 2024-08-17T02:47:21.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.281+0000 7f5cd8c00640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cbc065150 0x7f5cbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.281+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5cd4081fb0 con 0x7f5cdc155df0 2024-08-17T02:47:21.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.281+0000 7f5ce1800640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cbc065150 0x7f5cbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.282+0000 7f5ce1800640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cbc065150 0x7f5cbc067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0036000 tx=0x7f5cd0037000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:21.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.285+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5cd4050070 con 0x7f5cdc155df0 2024-08-17T02:47:21.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:21.517+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f5cdc0aa2f0 con 0x7f5cdc155df0 2024-08-17T02:47:22.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.261+0000 7f5cd8c00640 1 -- 172.21.15.149:0/3458118620 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5cd4053690 con 0x7f5cdc155df0 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cbc065150 msgr2=0x7f5cbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cbc065150 0x7f5cbc067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0036000 tx=0x7f5cd0037000 comp rx=0 tx=0).stop 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 msgr2=0x7f5cdc168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 0x7f5cdc168200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400bc30 tx=0x7f5cd4009840 comp rx=0 tx=0).stop 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 shutdown_connections 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5cbc065150 0x7f5cbc067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc155df0 0x7f5cdc168200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc155a20 0x7f5cdc0a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 --2- 172.21.15.149:0/3458118620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc06d7f0 0x7f5cdc0a7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 >> 172.21.15.149:0/3458118620 conn(0x7f5cdc0cb9b0 msgr2=0x7f5cdc154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:22.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 shutdown_connections 2024-08-17T02:47:22.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.264+0000 7f5ce4200640 1 -- 172.21.15.149:0/3458118620 wait complete. 2024-08-17T02:47:22.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:47:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.433+0000 7f8160000640 1 Processor -- start 2024-08-17T02:47:22.434 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.433+0000 7f8160000640 1 -- start start 2024-08-17T02:47:22.435 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.434+0000 7f8160000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:22.435 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.434+0000 7f8160000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 0x7f815815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:22.435 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.434+0000 7f8160000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815815c7b0 con 0x7f81580ae710 2024-08-17T02:47:22.435 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.434+0000 7f8160000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815815a030 con 0x7f8158068140 2024-08-17T02:47:22.435 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.434+0000 7f8160000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81580aeb60 con 0x7f815815c3e0 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815e000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 0x7f815815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815d600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815e000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 0x7f815815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:32998/0 (socket says 172.21.15.149:32998) 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815e000640 1 -- 172.21.15.149:0/4006423625 learned_addr learned my addr 172.21.15.149:0/4006423625 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815d600640 1 -- 172.21.15.149:0/4006423625 >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 msgr2=0x7f815815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815d600640 1 --2- 172.21.15.149:0/4006423625 >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 0x7f815815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815d600640 1 -- 172.21.15.149:0/4006423625 >> v1:172.21.15.161:6789/0 conn(0x7f81580ae710 legacy=0x7f8158067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815d600640 1 -- 172.21.15.149:0/4006423625 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158159700 con 0x7f815815c3e0 2024-08-17T02:47:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.435+0000 7f815e000640 1 --2- 172.21.15.149:0/4006423625 >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 0x7f815815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.436+0000 7f815d600640 1 --2- 172.21.15.149:0/4006423625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580ae1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f814c009850 tx=0x7f814c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece39439eea64be4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8157e00640 1 -- 172.21.15.149:0/4006423625 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c02ac60 con 0x7f815815c3e0 2024-08-17T02:47:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8157e00640 1 -- 172.21.15.149:0/4006423625 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c02adc0 con 0x7f815815c3e0 2024-08-17T02:47:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8157e00640 1 -- 172.21.15.149:0/4006423625 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c032670 con 0x7f815815c3e0 2024-08-17T02:47:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 -- 172.21.15.149:0/4006423625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 msgr2=0x7f81580ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 --2- 172.21.15.149:0/4006423625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580ae1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f814c009850 tx=0x7f814c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 -- 172.21.15.149:0/4006423625 shutdown_connections 2024-08-17T02:47:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 --2- 172.21.15.149:0/4006423625 >> v2:172.21.15.161:3300/0 conn(0x7f8158068140 0x7f815815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 --2- 172.21.15.149:0/4006423625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580ae1d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 -- 172.21.15.149:0/4006423625 >> 172.21.15.149:0/4006423625 conn(0x7f81580b17a0 msgr2=0x7f81580b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.437+0000 7f8160000640 1 -- 172.21.15.149:0/4006423625 shutdown_connections 2024-08-17T02:47:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.438+0000 7f8160000640 1 -- 172.21.15.149:0/4006423625 wait complete. 2024-08-17T02:47:22.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.439+0000 7f8160000640 1 Processor -- start 2024-08-17T02:47:22.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.439+0000 7f8160000640 1 -- start start 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f8160000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8158068140 0x7f81581693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f8160000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 0x7f8158099090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f8160000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f8160000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158096c00 con 0x7f81580ae710 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f8160000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158096ee0 con 0x7f8158068140 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f8160000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81580971c0 con 0x7f815815c3e0 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f815cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 0x7f8158099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f815cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 0x7f8158099090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50022/0 (socket says 172.21.15.149:50022) 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f815cc00640 1 -- 172.21.15.149:0/1468531242 learned_addr learned my addr 172.21.15.149:0/1468531242 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f815e000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:22.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.440+0000 7f815d600640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8158068140 0x7f81581693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f815cc00640 1 -- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 msgr2=0x7f81580995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f815cc00640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f815cc00640 1 -- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8158068140 msgr2=0x7f81581693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f815cc00640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8158068140 0x7f81581693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f815cc00640 1 -- 172.21.15.149:0/1468531242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8150009ae0 con 0x7f81580ae710 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f815cc00640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 0x7f8158099090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f814400c560 tx=0x7f8144007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144011590 con 0x7f81580ae710 2024-08-17T02:47:22.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8144011710 con 0x7f81580ae710 2024-08-17T02:47:22.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144011ad0 con 0x7f81580ae710 2024-08-17T02:47:22.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c009390 con 0x7f81580ae710 2024-08-17T02:47:22.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.441+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158097780 con 0x7f81580ae710 2024-08-17T02:47:22.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.442+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8158071050 con 0x7f81580ae710 2024-08-17T02:47:22.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.443+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f814401b3b0 con 0x7f81580ae710 2024-08-17T02:47:22.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.444+0000 7f8154c00640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8138065150 0x7f8138067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:22.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.444+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81440817e0 con 0x7f81580ae710 2024-08-17T02:47:22.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.444+0000 7f815d600640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8138065150 0x7f8138067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:22.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.445+0000 7f815d600640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8138065150 0x7f8138067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f814c034000 tx=0x7f814c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:22.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.448+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f814404f8b0 con 0x7f81580ae710 2024-08-17T02:47:22.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.620+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f815815c7b0 con 0x7f81580ae710 2024-08-17T02:47:22.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.624+0000 7f8154c00640 1 -- 172.21.15.149:0/1468531242 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f815815c7b0 con 0x7f81580ae710 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8138065150 msgr2=0x7f8138067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8138065150 0x7f8138067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f814c034000 tx=0x7f814c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 msgr2=0x7f8158099090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 0x7f8158099090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f814400c560 tx=0x7f8144007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 shutdown_connections 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8138065150 0x7f8138067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815815c3e0 0x7f81580995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81580ae710 0x7f8158099090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 --2- 172.21.15.149:0/1468531242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8158068140 0x7f81581693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 >> 172.21.15.149:0/1468531242 conn(0x7f81580b17a0 msgr2=0x7f8158158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 shutdown_connections 2024-08-17T02:47:22.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:22.627+0000 7f8160000640 1 -- 172.21.15.149:0/1468531242 wait complete. 2024-08-17T02:47:22.644 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:47:22.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:47:22.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:47:22.809 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:47:22.809 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:47:22.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:22.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:47:22.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:47:22.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:22.873 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:47:22.917 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:47:22.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:22.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:47:22.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:47:22.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:22.983 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:47:23.034 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:47:23.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:23.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:47:23.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:47:23.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.095 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:47:23.132 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:47:23.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:23.132 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:47:23.192 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:47:23.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.193 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:47:23.228 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:47:23.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:23.378 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.377+0000 7efda1600640 1 Processor -- start 2024-08-17T02:47:23.378 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.378+0000 7efda1600640 1 -- start start 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efda1600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd9c06df00 0x7efd9c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efda1600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd9c155df0 0x7efd9c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efda1600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c156670 con 0x7efd9c155a20 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efda1600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c0b0350 con 0x7efd9c06df00 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efda1600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c06e5e0 con 0x7efd9c155df0 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efd9a000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd9c06df00 0x7efd9c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efd9a000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd9c06df00 0x7efd9c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50032/0 (socket says 172.21.15.149:50032) 2024-08-17T02:47:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efd9a000640 1 -- 172.21.15.149:0/2340194701 learned_addr learned my addr 172.21.15.149:0/2340194701 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.379+0000 7efd9b400640 1 --2- 172.21.15.149:0/2340194701 >> v2:172.21.15.161:3300/0 conn(0x7efd9c155df0 0x7efd9c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.380+0000 7efd9a000640 1 -- 172.21.15.149:0/2340194701 >> v2:172.21.15.161:3300/0 conn(0x7efd9c155df0 msgr2=0x7efd9c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.380+0000 7efd9a000640 1 --2- 172.21.15.149:0/2340194701 >> v2:172.21.15.161:3300/0 conn(0x7efd9c155df0 0x7efd9c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.380+0000 7efd9a000640 1 -- 172.21.15.149:0/2340194701 >> v1:172.21.15.161:6789/0 conn(0x7efd9c155a20 legacy=0x7efd9c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.380+0000 7efd9a000640 1 -- 172.21.15.149:0/2340194701 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c06e8c0 con 0x7efd9c06df00 2024-08-17T02:47:23.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.381+0000 7efd9a000640 1 --2- 172.21.15.149:0/2340194701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c06df00 0x7efd9c0adf10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0b0710 tx=0x7efd880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95c28909d68662e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.381+0000 7efd99600640 1 -- 172.21.15.149:0/2340194701 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8802adf0 con 0x7efd9c06df00 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.381+0000 7efd99600640 1 -- 172.21.15.149:0/2340194701 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88032440 con 0x7efd9c06df00 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.381+0000 7efd99600640 1 -- 172.21.15.149:0/2340194701 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88032820 con 0x7efd9c06df00 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.381+0000 7efda1600640 1 -- 172.21.15.149:0/2340194701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c06df00 msgr2=0x7efd9c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.381+0000 7efda1600640 1 --2- 172.21.15.149:0/2340194701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c06df00 0x7efd9c0adf10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0b0710 tx=0x7efd880091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.382+0000 7efda1600640 1 -- 172.21.15.149:0/2340194701 shutdown_connections 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.382+0000 7efda1600640 1 --2- 172.21.15.149:0/2340194701 >> v2:172.21.15.161:3300/0 conn(0x7efd9c155df0 0x7efd9c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.382+0000 7efda1600640 1 --2- 172.21.15.149:0/2340194701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c06df00 0x7efd9c0adf10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.382+0000 7efda1600640 1 -- 172.21.15.149:0/2340194701 >> 172.21.15.149:0/2340194701 conn(0x7efd9c0cb9b0 msgr2=0x7efd9c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.382+0000 7efda1600640 1 -- 172.21.15.149:0/2340194701 shutdown_connections 2024-08-17T02:47:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.382+0000 7efda1600640 1 -- 172.21.15.149:0/2340194701 wait complete. 2024-08-17T02:47:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.383+0000 7efda1600640 1 Processor -- start 2024-08-17T02:47:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.383+0000 7efda1600640 1 -- start start 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efda1600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd9c06df00 0x7efd9c1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efda1600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd9c155a20 0x7efd9c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efda1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 0x7efd9c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efda1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c0ad420 con 0x7efd9c155df0 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efda1600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c141910 con 0x7efd9c06df00 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efda1600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c0acaf0 con 0x7efd9c155a20 2024-08-17T02:47:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efd9b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 0x7efd9c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efd9b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 0x7efd9c158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50036/0 (socket says 172.21.15.149:50036) 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.384+0000 7efd9b400640 1 -- 172.21.15.149:0/7241039 learned_addr learned my addr 172.21.15.149:0/7241039 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9a000640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd9c155a20 0x7efd9c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9aa00640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd9c06df00 0x7efd9c1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9b400640 1 -- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd9c155a20 msgr2=0x7efd9c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9b400640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd9c155a20 0x7efd9c157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9b400640 1 -- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd9c06df00 msgr2=0x7efd9c1413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9b400640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd9c06df00 0x7efd9c1413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9b400640 1 -- 172.21.15.149:0/7241039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88009450 con 0x7efd9c155df0 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9aa00640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd9c06df00 0x7efd9c1413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd9b400640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 0x7efd9c158300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efd94009d70 tx=0x7efd9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400cd40 con 0x7efd9c155df0 2024-08-17T02:47:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9400f040 con 0x7efd9c155df0 2024-08-17T02:47:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c0acdd0 con 0x7efd9c155df0 2024-08-17T02:47:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400cea0 con 0x7efd9c155df0 2024-08-17T02:47:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.385+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c0ac710 con 0x7efd9c155df0 2024-08-17T02:47:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.387+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9c064db0 con 0x7efd9c155df0 2024-08-17T02:47:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.387+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd94014920 con 0x7efd9c155df0 2024-08-17T02:47:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.388+0000 7efd92000640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efd7c065150 0x7efd7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.388+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd94083240 con 0x7efd9c155df0 2024-08-17T02:47:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.389+0000 7efd9aa00640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efd7c065150 0x7efd7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.389+0000 7efd9aa00640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efd7c065150 0x7efd7c067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0017a0 tx=0x7efd8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.393+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efd94051260 con 0x7efd9c155df0 2024-08-17T02:47:23.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.600+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd9c0ad560 con 0x7efd9c155df0 2024-08-17T02:47:23.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.601+0000 7efd92000640 1 -- 172.21.15.149:0/7241039 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7efd94054880 con 0x7efd9c155df0 2024-08-17T02:47:23.602 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:23.602 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:23.602 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efd7c065150 msgr2=0x7efd7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efd7c065150 0x7efd7c067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0017a0 tx=0x7efd8c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 msgr2=0x7efd9c158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 0x7efd9c158300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efd94009d70 tx=0x7efd9400b040 comp rx=0 tx=0).stop 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 shutdown_connections 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efd7c065150 0x7efd7c067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd9c155df0 0x7efd9c158300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd9c155a20 0x7efd9c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 --2- 172.21.15.149:0/7241039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd9c06df00 0x7efd9c1413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 >> 172.21.15.149:0/7241039 conn(0x7efd9c0cb9b0 msgr2=0x7efd9c15b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 shutdown_connections 2024-08-17T02:47:23.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.603+0000 7efda1600640 1 -- 172.21.15.149:0/7241039 wait complete. 2024-08-17T02:47:23.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:23.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.768+0000 7fd7b3e00640 1 Processor -- start 2024-08-17T02:47:23.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.768+0000 7fd7b3e00640 1 -- start start 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b3e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd7b4159ca0 0x7fd7b40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd7b40ccca0 0x7fd7b4162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b3e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b40cadc0 con 0x7fd7b40ca8a0 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b3e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40cd6e0 con 0x7fd7b4159ca0 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b3e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40cb060 con 0x7fd7b40ccca0 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd7b4159ca0 0x7fd7b40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b2000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd7b40ca8a0 0x7fd7b40cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45200/0 (socket says 172.21.15.149:45200) 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd7b4159ca0 0x7fd7b40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50040/0 (socket says 172.21.15.149:50040) 2024-08-17T02:47:23.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.769+0000 7fd7b2000640 1 -- 172.21.15.149:0/2387983383 learned_addr learned my addr 172.21.15.149:0/2387983383 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:23.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.770+0000 7fd7b3400640 1 --2- 172.21.15.149:0/2387983383 >> v2:172.21.15.161:3300/0 conn(0x7fd7b40ccca0 0x7fd7b4162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.770+0000 7fd7b2a00640 1 -- 172.21.15.149:0/2387983383 >> v2:172.21.15.161:3300/0 conn(0x7fd7b40ccca0 msgr2=0x7fd7b4162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.770+0000 7fd7b2a00640 1 --2- 172.21.15.149:0/2387983383 >> v2:172.21.15.161:3300/0 conn(0x7fd7b40ccca0 0x7fd7b4162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.770+0000 7fd7b2a00640 1 -- 172.21.15.149:0/2387983383 >> v1:172.21.15.149:6789/0 conn(0x7fd7b40ca8a0 legacy=0x7fd7b40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.770+0000 7fd7b2a00640 1 -- 172.21.15.149:0/2387983383 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b40cb300 con 0x7fd7b4159ca0 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.770+0000 7fd7b1600640 1 -- 172.21.15.149:0/2387983383 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223889635 0 0) 0x7fd7b40cadc0 con 0x7fd7b40ca8a0 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.771+0000 7fd7b2a00640 1 --2- 172.21.15.149:0/2387983383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b4159ca0 0x7fd7b40ca360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40b26e0 tx=0x7fd7a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b698a8dce6acff2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.771+0000 7fd7b1600640 1 -- 172.21.15.149:0/2387983383 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a402adb0 con 0x7fd7b4159ca0 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.771+0000 7fd7b1600640 1 -- 172.21.15.149:0/2387983383 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4032440 con 0x7fd7b4159ca0 2024-08-17T02:47:23.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.771+0000 7fd7b1600640 1 -- 172.21.15.149:0/2387983383 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40327e0 con 0x7fd7b4159ca0 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2387983383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b4159ca0 msgr2=0x7fd7b40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2387983383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b4159ca0 0x7fd7b40ca360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40b26e0 tx=0x7fd7a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2387983383 shutdown_connections 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2387983383 >> v2:172.21.15.161:3300/0 conn(0x7fd7b40ccca0 0x7fd7b4162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2387983383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b4159ca0 0x7fd7b40ca360 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2387983383 >> 172.21.15.149:0/2387983383 conn(0x7fd7b4098e00 msgr2=0x7fd7b406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2387983383 shutdown_connections 2024-08-17T02:47:23.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.772+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2387983383 wait complete. 2024-08-17T02:47:23.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.773+0000 7fd7b3e00640 1 Processor -- start 2024-08-17T02:47:23.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 -- start start 2024-08-17T02:47:23.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b40ca8a0 0x7fd7b40c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 0x7fd7b4158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7b4159ca0 0x7fd7b4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4169a60 con 0x7fd7b40ccca0 2024-08-17T02:47:23.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40c5f00 con 0x7fd7b40ca8a0 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.774+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40c55d0 con 0x7fd7b4159ca0 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 0x7fd7b4158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 0x7fd7b4158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50044/0 (socket says 172.21.15.149:50044) 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 -- 172.21.15.149:0/2617488746 learned_addr learned my addr 172.21.15.149:0/2617488746 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2a00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b40ca8a0 0x7fd7b40c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b3400640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7b4159ca0 0x7fd7b4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 -- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7b4159ca0 msgr2=0x7fd7b4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7b4159ca0 0x7fd7b4154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 -- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b40ca8a0 msgr2=0x7fd7b40c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b40ca8a0 0x7fd7b40c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 -- 172.21.15.149:0/2617488746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4009390 con 0x7fd7b40ccca0 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b3400640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7b4159ca0 0x7fd7b4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.775+0000 7fd7b2000640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 0x7fd7b4158560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000c520 tx=0x7fd7a0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.776+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0005aa0 con 0x7fd7b40ccca0 2024-08-17T02:47:23.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.776+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0005c20 con 0x7fd7b40ccca0 2024-08-17T02:47:23.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.776+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b40c58b0 con 0x7fd7b40ccca0 2024-08-17T02:47:23.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.776+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00070d0 con 0x7fd7b40ccca0 2024-08-17T02:47:23.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.776+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b40c68d0 con 0x7fd7b40ccca0 2024-08-17T02:47:23.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.777+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b4071050 con 0x7fd7b40ccca0 2024-08-17T02:47:23.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.778+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd7a0007480 con 0x7fd7b40ccca0 2024-08-17T02:47:23.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.778+0000 7fd7aa000640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd794065150 0x7fd794067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.779+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7a0081990 con 0x7fd7b40ccca0 2024-08-17T02:47:23.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.779+0000 7fd7b2a00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd794065150 0x7fd794067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.779+0000 7fd7b2a00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd794065150 0x7fd794067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4034000 tx=0x7fd7a4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.783+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd7a004fa60 con 0x7fd7b40ccca0 2024-08-17T02:47:23.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.959+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7b4156060 con 0x7fd7b40ccca0 2024-08-17T02:47:23.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.960+0000 7fd7aa000640 1 -- 172.21.15.149:0/2617488746 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd7a0017090 con 0x7fd7b40ccca0 2024-08-17T02:47:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:23.961 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:23.963 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd794065150 msgr2=0x7fd794067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.963 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd794065150 0x7fd794067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4034000 tx=0x7fd7a4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:23.963 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 msgr2=0x7fd7b4158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.963 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 0x7fd7b4158560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000c520 tx=0x7fd7a0007f50 comp rx=0 tx=0).stop 2024-08-17T02:47:23.963 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 shutdown_connections 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd794065150 0x7fd794067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7b4159ca0 0x7fd7b4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b40ccca0 0x7fd7b4158560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 --2- 172.21.15.149:0/2617488746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b40ca8a0 0x7fd7b40c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 >> 172.21.15.149:0/2617488746 conn(0x7fd7b4098e00 msgr2=0x7fd7b40ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 shutdown_connections 2024-08-17T02:47:23.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:23.962+0000 7fd7b3e00640 1 -- 172.21.15.149:0/2617488746 wait complete. 2024-08-17T02:47:23.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:46.862390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:47.456535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:23.978 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:24.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.129+0000 7fdf51c00640 1 Processor -- start 2024-08-17T02:47:24.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.129+0000 7fdf51c00640 1 -- start start 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf51c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf4c0aede0 0x7fdf4c0aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf51c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c0ad940 con 0x7fdf4c153320 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf51c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c159b20 con 0x7fdf4c066cd0 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf51c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c06e700 con 0x7fdf4c0aede0 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf4aa00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdf4c153320 0x7fdf4c159340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45214/0 (socket says 172.21.15.149:45214) 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf4aa00640 1 -- 172.21.15.149:0/3157984718 learned_addr learned my addr 172.21.15.149:0/3157984718 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.130+0000 7fdf4a000640 1 --2- 172.21.15.149:0/3157984718 >> v2:172.21.15.149:3300/0 conn(0x7fdf4c0aede0 0x7fdf4c0aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.131+0000 7fdf4a000640 1 -- 172.21.15.149:0/3157984718 >> v1:172.21.15.161:6789/0 conn(0x7fdf4c066cd0 legacy=0x7fdf4c162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.131+0000 7fdf4a000640 1 -- 172.21.15.149:0/3157984718 >> v1:172.21.15.149:6789/0 conn(0x7fdf4c153320 legacy=0x7fdf4c159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.131+0000 7fdf4a000640 1 -- 172.21.15.149:0/3157984718 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c159e00 con 0x7fdf4c0aede0 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.131+0000 7fdf49600640 1 -- 172.21.15.149:0/3157984718 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569235155 0 0) 0x7fdf4c0ad940 con 0x7fdf4c153320 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.132+0000 7fdf4a000640 1 --2- 172.21.15.149:0/3157984718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c0aacb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009850 tx=0x7fdf380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b473931b4f5523 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.132+0000 7fdf49600640 1 -- 172.21.15.149:0/3157984718 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3802ad90 con 0x7fdf4c0aede0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.132+0000 7fdf49600640 1 -- 172.21.15.149:0/3157984718 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf38032440 con 0x7fdf4c0aede0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.132+0000 7fdf49600640 1 -- 172.21.15.149:0/3157984718 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380327e0 con 0x7fdf4c0aede0 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 -- 172.21.15.149:0/3157984718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c0aede0 msgr2=0x7fdf4c0aacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 --2- 172.21.15.149:0/3157984718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c0aacb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009850 tx=0x7fdf380090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 -- 172.21.15.149:0/3157984718 shutdown_connections 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 --2- 172.21.15.149:0/3157984718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c0aacb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 -- 172.21.15.149:0/3157984718 >> 172.21.15.149:0/3157984718 conn(0x7fdf4c06d8b0 msgr2=0x7fdf4c06dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 -- 172.21.15.149:0/3157984718 shutdown_connections 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.133+0000 7fdf51c00640 1 -- 172.21.15.149:0/3157984718 wait complete. 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.134+0000 7fdf51c00640 1 Processor -- start 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.134+0000 7fdf51c00640 1 -- start start 2024-08-17T02:47:24.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf51c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf4c066cd0 0x7fdf4c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf51c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf51c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 0x7fdf4c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf51c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c15c040 con 0x7fdf4c153320 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf51c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c157ae0 con 0x7fdf4c0aede0 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf51c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c154540 con 0x7fdf4c066cd0 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.135+0000 7fdf4b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 0x7fdf4c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 0x7fdf4c153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50054/0 (socket says 172.21.15.149:50054) 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 -- 172.21.15.149:0/42353969 learned_addr learned my addr 172.21.15.149:0/42353969 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4aa00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf4c066cd0 0x7fdf4c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4a000640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.138 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 -- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf4c066cd0 msgr2=0x7fdf4c14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf4c066cd0 0x7fdf4c14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 -- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf4c0aede0 msgr2=0x7fdf4c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 -- 172.21.15.149:0/42353969 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38009390 con 0x7fdf4c153320 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4aa00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf4c066cd0 0x7fdf4c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4a000640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.136+0000 7fdf4b400640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 0x7fdf4c153f30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c860 tx=0x7fdf44001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.137+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400ce50 con 0x7fdf4c153320 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.137+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4400a850 con 0x7fdf4c153320 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.137+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c154820 con 0x7fdf4c153320 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.137+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400ac10 con 0x7fdf4c153320 2024-08-17T02:47:24.139 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.137+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c157d80 con 0x7fdf4c153320 2024-08-17T02:47:24.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.138+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c154d20 con 0x7fdf4c153320 2024-08-17T02:47:24.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.139+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf44012630 con 0x7fdf4c153320 2024-08-17T02:47:24.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.139+0000 7fdf42000640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fdf2c065150 0x7fdf2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.140+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf44082770 con 0x7fdf4c153320 2024-08-17T02:47:24.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.140+0000 7fdf4aa00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fdf2c065150 0x7fdf2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.140+0000 7fdf4aa00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fdf2c065150 0x7fdf2c067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c007fd0 tx=0x7fdf3c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.143+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf44050790 con 0x7fdf4c153320 2024-08-17T02:47:24.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.318+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf4c064db0 con 0x7fdf4c153320 2024-08-17T02:47:24.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.318+0000 7fdf42000640 1 -- 172.21.15.149:0/42353969 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf44053db0 con 0x7fdf4c153320 2024-08-17T02:47:24.319 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:24.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fdf2c065150 msgr2=0x7fdf2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fdf2c065150 0x7fdf2c067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c007fd0 tx=0x7fdf3c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:24.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 msgr2=0x7fdf4c153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 0x7fdf4c153f30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c860 tx=0x7fdf44001690 comp rx=0 tx=0).stop 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 shutdown_connections 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fdf2c065150 0x7fdf2c067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c153320 0x7fdf4c153f30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf4c0aede0 0x7fdf4c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 --2- 172.21.15.149:0/42353969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf4c066cd0 0x7fdf4c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 >> 172.21.15.149:0/42353969 conn(0x7fdf4c06d8b0 msgr2=0x7fdf4c152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 shutdown_connections 2024-08-17T02:47:24.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.321+0000 7fdf51c00640 1 -- 172.21.15.149:0/42353969 wait complete. 2024-08-17T02:47:24.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.487+0000 7f022b200640 1 Processor -- start 2024-08-17T02:47:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.488+0000 7f022b200640 1 -- start start 2024-08-17T02:47:24.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f022b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c158940 0x7f022c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f022b200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f022c158d10 0x7f022c066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f022b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c06e660 con 0x7f022c159160 2024-08-17T02:47:24.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f022b200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c0a9b70 con 0x7f022c158d10 2024-08-17T02:47:24.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f022b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c06da50 con 0x7f022c158940 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f0229400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f022c158d10 0x7f022c066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f0229400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f022c158d10 0x7f022c066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50070/0 (socket says 172.21.15.149:50070) 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f0229400640 1 -- 172.21.15.149:0/3955861306 learned_addr learned my addr 172.21.15.149:0/3955861306 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f022a800640 1 --1- 172.21.15.149:0/3955861306 >> v1:172.21.15.149:6789/0 conn(0x7f022c159160 0x7f022c0af8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45228/0 (socket says 172.21.15.149:45228) 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f0229e00640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c158940 0x7f022c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.489+0000 7f0229400640 1 -- 172.21.15.149:0/3955861306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c158940 msgr2=0x7f022c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.490+0000 7f0229400640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c158940 0x7f022c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.490+0000 7f0229400640 1 -- 172.21.15.149:0/3955861306 >> v1:172.21.15.149:6789/0 conn(0x7f022c159160 legacy=0x7f022c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.490+0000 7f0229400640 1 -- 172.21.15.149:0/3955861306 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c06dd30 con 0x7f022c158d10 2024-08-17T02:47:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.490+0000 7f0229e00640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c158940 0x7f022c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f0229400640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c066cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0218009910 tx=0x7f02180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0526e450659297 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f0228a00640 1 -- 172.21.15.149:0/3955861306 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021802ad20 con 0x7f022c158d10 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f0228a00640 1 -- 172.21.15.149:0/3955861306 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021802ae80 con 0x7f022c158d10 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f0228a00640 1 -- 172.21.15.149:0/3955861306 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218032670 con 0x7f022c158d10 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f022b200640 1 -- 172.21.15.149:0/3955861306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 msgr2=0x7f022c066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f022b200640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c066cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0218009910 tx=0x7f02180091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f022b200640 1 -- 172.21.15.149:0/3955861306 shutdown_connections 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f022b200640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c066cd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f022b200640 1 --2- 172.21.15.149:0/3955861306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c158940 0x7f022c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.491+0000 7f022b200640 1 -- 172.21.15.149:0/3955861306 >> 172.21.15.149:0/3955861306 conn(0x7f022c067de0 msgr2=0x7f022c0681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.492+0000 7f022b200640 1 -- 172.21.15.149:0/3955861306 shutdown_connections 2024-08-17T02:47:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.492+0000 7f022b200640 1 -- 172.21.15.149:0/3955861306 wait complete. 2024-08-17T02:47:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.493+0000 7f022b200640 1 Processor -- start 2024-08-17T02:47:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.493+0000 7f022b200640 1 -- start start 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022b200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c158940 0x7f022c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c159160 0x7f022c0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c15a1f0 con 0x7f022c158d10 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022b200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1595e0 con 0x7f022c158940 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1598c0 con 0x7f022c159160 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f0229400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f0229400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50086/0 (socket says 172.21.15.149:50086) 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f0229400640 1 -- 172.21.15.149:0/885147595 learned_addr learned my addr 172.21.15.149:0/885147595 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f0229e00640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c158940 0x7f022c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.494+0000 7f022a800640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c159160 0x7f022c0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0229400640 1 -- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c159160 msgr2=0x7f022c0acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0229400640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c159160 0x7f022c0acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0229400640 1 -- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c158940 msgr2=0x7f022c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0229400640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c158940 0x7f022c15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0229400640 1 -- 172.21.15.149:0/885147595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009450 con 0x7f022c158d10 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0229400640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c152c30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0218035040 tx=0x7f0218032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218031780 con 0x7f022c158d10 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218031900 con 0x7f022c158d10 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218031d00 con 0x7f022c158d10 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c159ba0 con 0x7f022c158d10 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.495+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c15cbf0 con 0x7f022c158d10 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.496+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c15a3a0 con 0x7f022c158d10 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.497+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0218039040 con 0x7f022c158d10 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.498+0000 7f0221600640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f020c065150 0x7f020c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.498+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0218042030 con 0x7f022c158d10 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.498+0000 7f0229e00640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f020c065150 0x7f020c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.499+0000 7f0229e00640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f020c065150 0x7f020c067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f021c00acc0 tx=0x7f021c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.502+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f022c15a3a0 con 0x7f022c158d10 2024-08-17T02:47:24.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.673+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f022c071050 con 0x7f022c158d10 2024-08-17T02:47:24.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.673+0000 7f0221600640 1 -- 172.21.15.149:0/885147595 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f021804c020 con 0x7f022c158d10 2024-08-17T02:47:24.674 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:47:24.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f020c065150 msgr2=0x7f020c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f020c065150 0x7f020c067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f021c00acc0 tx=0x7f021c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 msgr2=0x7f022c152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c152c30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0218035040 tx=0x7f0218032000 comp rx=0 tx=0).stop 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 shutdown_connections 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f020c065150 0x7f020c067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022c159160 0x7f022c0acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f022c158d10 0x7f022c152c30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 --2- 172.21.15.149:0/885147595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c158940 0x7f022c15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 >> 172.21.15.149:0/885147595 conn(0x7f022c067de0 msgr2=0x7f022c0cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 shutdown_connections 2024-08-17T02:47:24.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.676+0000 7f022b200640 1 -- 172.21.15.149:0/885147595 wait complete. 2024-08-17T02:47:24.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:24.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.841+0000 7f07f7200640 1 Processor -- start 2024-08-17T02:47:24.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.842+0000 7f07f7200640 1 -- start start 2024-08-17T02:47:24.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f7200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f07f80adfb0 0x7f07f80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f7200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155a30 0x7f07f806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f7200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80afc40 con 0x7f07f8155660 2024-08-17T02:47:24.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f7200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80af030 con 0x7f07f80adfb0 2024-08-17T02:47:24.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f7200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80af310 con 0x7f07f8155a30 2024-08-17T02:47:24.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f5e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f07f8155660 0x7f07f80c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45240/0 (socket says 172.21.15.149:45240) 2024-08-17T02:47:24.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f5e00640 1 -- 172.21.15.149:0/1759982308 learned_addr learned my addr 172.21.15.149:0/1759982308 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:24.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07ed400640 1 --2- 172.21.15.149:0/1759982308 >> v2:172.21.15.161:3300/0 conn(0x7f07f80adfb0 0x7f07f80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.843+0000 7f07f6800640 1 --2- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155a30 0x7f07f806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.844+0000 7f07f5400640 1 -- 172.21.15.149:0/1759982308 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22176440 0 0) 0x7f07f80afc40 con 0x7f07f8155660 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.844+0000 7f07f5400640 1 -- 172.21.15.149:0/1759982308 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc0034e0 con 0x7f07f8155660 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.844+0000 7f07ed400640 1 -- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155a30 msgr2=0x7f07f806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.844+0000 7f07ed400640 1 --2- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155a30 0x7f07f806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.844+0000 7f07ed400640 1 -- 172.21.15.149:0/1759982308 >> v1:172.21.15.149:6789/0 conn(0x7f07f8155660 legacy=0x7f07f80c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.844+0000 7f07ed400640 1 -- 172.21.15.149:0/1759982308 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80af5f0 con 0x7f07f80adfb0 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.845+0000 7f07ed400640 1 --2- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f80ae750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009850 tx=0x7f07e00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c84f73028ed525e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.845+0000 7f07f5400640 1 -- 172.21.15.149:0/1759982308 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e002ad90 con 0x7f07f80adfb0 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.845+0000 7f07f5400640 1 -- 172.21.15.149:0/1759982308 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0032440 con 0x7f07f80adfb0 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.845+0000 7f07f5400640 1 -- 172.21.15.149:0/1759982308 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0032820 con 0x7f07f80adfb0 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 -- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 msgr2=0x7f07f80ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 --2- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f80ae750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009850 tx=0x7f07e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 -- 172.21.15.149:0/1759982308 shutdown_connections 2024-08-17T02:47:24.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 --2- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155a30 0x7f07f806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 --2- 172.21.15.149:0/1759982308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f80ae750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 -- 172.21.15.149:0/1759982308 >> 172.21.15.149:0/1759982308 conn(0x7f07f8066cd0 msgr2=0x7f07f80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 -- 172.21.15.149:0/1759982308 shutdown_connections 2024-08-17T02:47:24.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.846+0000 7f07f7200640 1 -- 172.21.15.149:0/1759982308 wait complete. 2024-08-17T02:47:24.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.847+0000 7f07f7200640 1 Processor -- start 2024-08-17T02:47:24.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.847+0000 7f07f7200640 1 -- start start 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f7200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f8153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f7200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155660 0x7f07f814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 0x7f07f815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81533f0 con 0x7f07f8155a30 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f7200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81527e0 con 0x7f07f80adfb0 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f7200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8152ac0 con 0x7f07f8155660 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 0x7f07f815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 0x7f07f815a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50094/0 (socket says 172.21.15.149:50094) 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.848+0000 7f07f6800640 1 -- 172.21.15.149:0/821815292 learned_addr learned my addr 172.21.15.149:0/821815292 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f5e00640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f6800640 1 -- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155660 msgr2=0x7f07f814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f6800640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155660 0x7f07f814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f6800640 1 -- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 msgr2=0x7f07f8153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f6800640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f8153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f6800640 1 -- 172.21.15.149:0/821815292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0009390 con 0x7f07f8155a30 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f5e00640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07f6800640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 0x7f07f815a7c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009df0 tx=0x7f07f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000cdd0 con 0x7f07f8155a30 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f000f040 con 0x7f07f8155a30 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.849+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00146d0 con 0x7f07f8155a30 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.850+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f8152da0 con 0x7f07f8155a30 2024-08-17T02:47:24.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.850+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f8150400 con 0x7f07f8155a30 2024-08-17T02:47:24.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.851+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8153560 con 0x7f07f8155a30 2024-08-17T02:47:24.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.851+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f07f0014a80 con 0x7f07f8155a30 2024-08-17T02:47:24.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.852+0000 7f07ee000640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f07d4065150 0x7f07d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.852+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07f0082ff0 con 0x7f07f8155a30 2024-08-17T02:47:24.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.853+0000 7f07f5e00640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f07d4065150 0x7f07d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.853+0000 7f07f5e00640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f07d4065150 0x7f07d4067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07e8007fd0 tx=0x7f07e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:24.856+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f07f0051010 con 0x7f07f8155a30 2024-08-17T02:47:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.026+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07f8071050 con 0x7f07f8155a30 2024-08-17T02:47:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.027+0000 7f07ee000640 1 -- 172.21.15.149:0/821815292 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07f0018020 con 0x7f07f8155a30 2024-08-17T02:47:25.028 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f07d4065150 msgr2=0x7f07d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f07d4065150 0x7f07d4067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07e8007fd0 tx=0x7f07e8009040 comp rx=0 tx=0).stop 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 msgr2=0x7f07f815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 0x7f07f815a7c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009df0 tx=0x7f07f000b040 comp rx=0 tx=0).stop 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 shutdown_connections 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f07d4065150 0x7f07d4067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8155a30 0x7f07f815a7c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07f8155660 0x7f07f814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 --2- 172.21.15.149:0/821815292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07f80adfb0 0x7f07f8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 >> 172.21.15.149:0/821815292 conn(0x7f07f8066cd0 msgr2=0x7f07f8069350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 shutdown_connections 2024-08-17T02:47:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.029+0000 7f07f7200640 1 -- 172.21.15.149:0/821815292 wait complete. 2024-08-17T02:47:25.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:25.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.192+0000 7f00fb800640 1 Processor -- start 2024-08-17T02:47:25.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.192+0000 7f00fb800640 1 -- start start 2024-08-17T02:47:25.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.193+0000 7f00fb800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00f40c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.193+0000 7f00fb800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40caa80 con 0x7f00f41401b0 2024-08-17T02:47:25.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.193+0000 7f00fb800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40c9e70 con 0x7f00f40b1440 2024-08-17T02:47:25.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.193+0000 7f00fb800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c9c90 con 0x7f00f4140580 2024-08-17T02:47:25.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.193+0000 7f00f8e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f00f41401b0 0x7f00f40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45254/0 (socket says 172.21.15.149:45254) 2024-08-17T02:47:25.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.193+0000 7f00f8e00640 1 -- 172.21.15.149:0/1798926812 learned_addr learned my addr 172.21.15.149:0/1798926812 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877366309 0 0) 0x7f00f40caa80 con 0x7f00f41401b0 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f9800640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00f40c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00dc0034e0 con 0x7f00f41401b0 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298272508 0 0) 0x7f00dc0034e0 con 0x7f00f41401b0 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 msgr2=0x7f00f40c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00f40c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 >> v1:172.21.15.161:6789/0 conn(0x7f00f40b1440 legacy=0x7f00f40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40ca150 con 0x7f00f41401b0 2024-08-17T02:47:25.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f00e8001470 con 0x7f00f41401b0 2024-08-17T02:47:25.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 >> v1:172.21.15.149:6789/0 conn(0x7f00f41401b0 legacy=0x7f00f40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc003a00 0x7f00dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00dc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc004cc0 0x7f00dc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c9c90 con 0x7f00dc004cc0 2024-08-17T02:47:25.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00bab0 con 0x7f00dc003a00 2024-08-17T02:47:25.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.194+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00bc70 con 0x7f00f4140580 2024-08-17T02:47:25.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f8e00640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc003a00 0x7f00dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f3e00640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00dc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f9800640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc004cc0 0x7f00dc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f9800640 1 -- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 msgr2=0x7f00dc004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f9800640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00dc004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f9800640 1 -- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc003a00 msgr2=0x7f00dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f9800640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc003a00 0x7f00dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f9800640 1 -- 172.21.15.149:0/1798926812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc0034e0 con 0x7f00dc004cc0 2024-08-17T02:47:25.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.195+0000 7f00f3e00640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f4140580 0x7f00dc004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:25.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.196+0000 7f00f9800640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc004cc0 0x7f00dc005130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e210 tx=0x7f00ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a478a56d47930e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.196+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec031460 con 0x7f00dc004cc0 2024-08-17T02:47:25.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.196+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00f040 con 0x7f00dc004cc0 2024-08-17T02:47:25.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.196+0000 7f00f3400640 1 -- 172.21.15.149:0/1798926812 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0317f0 con 0x7f00dc004cc0 2024-08-17T02:47:25.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00fb800640 1 -- 172.21.15.149:0/1798926812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc004cc0 msgr2=0x7f00dc005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00fb800640 1 --2- 172.21.15.149:0/1798926812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc004cc0 0x7f00dc005130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e210 tx=0x7f00ec00b040 comp rx=0 tx=0).stop 2024-08-17T02:47:25.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00f9800640 1 -- 172.21.15.149:0/1798926812 reap_dead start 2024-08-17T02:47:25.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00fb800640 1 -- 172.21.15.149:0/1798926812 shutdown_connections 2024-08-17T02:47:25.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00fb800640 1 -- 172.21.15.149:0/1798926812 >> 172.21.15.149:0/1798926812 conn(0x7f00f40cb9b0 msgr2=0x7f00f40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:25.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00fb800640 1 -- 172.21.15.149:0/1798926812 shutdown_connections 2024-08-17T02:47:25.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.197+0000 7f00fb800640 1 -- 172.21.15.149:0/1798926812 wait complete. 2024-08-17T02:47:25.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.198+0000 7f00fb800640 1 Processor -- start 2024-08-17T02:47:25.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 -- start start 2024-08-17T02:47:25.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc004cc0 0x7f00f41353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f40c7450 0x7f00f40c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 0x7f00f40a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40af8d0 con 0x7f00f40a5e90 2024-08-17T02:47:25.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40a7360 con 0x7f00dc004cc0 2024-08-17T02:47:25.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.199+0000 7f00fb800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c7e00 con 0x7f00f40c7450 2024-08-17T02:47:25.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 0x7f00f40a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 0x7f00f40a6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50106/0 (socket says 172.21.15.149:50106) 2024-08-17T02:47:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 -- 172.21.15.149:0/112665868 learned_addr learned my addr 172.21.15.149:0/112665868 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f3e00640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f40c7450 0x7f00f40c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f8e00640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc004cc0 0x7f00f41353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 -- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f40c7450 msgr2=0x7f00f40c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f40c7450 0x7f00f40c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 -- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc004cc0 msgr2=0x7f00f41353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc004cc0 0x7f00f41353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 -- 172.21.15.149:0/112665868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40a6870 con 0x7f00f40a5e90 2024-08-17T02:47:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.200+0000 7f00f9800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 0x7f00f40a6330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e210 tx=0x7f00ec036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.201+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0307d0 con 0x7f00f40a5e90 2024-08-17T02:47:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.201+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec030950 con 0x7f00f40a5e90 2024-08-17T02:47:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.201+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec030b00 con 0x7f00f40a5e90 2024-08-17T02:47:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.201+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f4168a50 con 0x7f00f40a5e90 2024-08-17T02:47:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.201+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f40a6da0 con 0x7f00f40a5e90 2024-08-17T02:47:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.202+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f4064db0 con 0x7f00f40a5e90 2024-08-17T02:47:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.203+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00ec043020 con 0x7f00f40a5e90 2024-08-17T02:47:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.203+0000 7f00e7e00640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f00d4065180 0x7f00d4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.203+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00ec0a3c60 con 0x7f00f40a5e90 2024-08-17T02:47:25.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.204+0000 7f00f8e00640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f00d4065180 0x7f00d4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.204+0000 7f00f8e00640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f00d4065180 0x7f00d4067630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00e8007df0 tx=0x7f00e8001da0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.207+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f00ec071d30 con 0x7f00f40a5e90 2024-08-17T02:47:25.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.414+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00f40c1600 con 0x7f00f40a5e90 2024-08-17T02:47:25.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.415+0000 7f00e7e00640 1 -- 172.21.15.149:0/112665868 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f00ec075350 con 0x7f00f40a5e90 2024-08-17T02:47:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:25.416 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:25.416 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f00d4065180 msgr2=0x7f00d4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f00d4065180 0x7f00d4067630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00e8007df0 tx=0x7f00e8001da0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 msgr2=0x7f00f40a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 0x7f00f40a6330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e210 tx=0x7f00ec036000 comp rx=0 tx=0).stop 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 shutdown_connections 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f00d4065180 0x7f00d4067630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00f40a5e90 0x7f00f40a6330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f40c7450 0x7f00f40c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 --2- 172.21.15.149:0/112665868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00dc004cc0 0x7f00f41353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 >> 172.21.15.149:0/112665868 conn(0x7f00f40cb9b0 msgr2=0x7f00f4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:25.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 shutdown_connections 2024-08-17T02:47:25.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.417+0000 7f00fb800640 1 -- 172.21.15.149:0/112665868 wait complete. 2024-08-17T02:47:25.434 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:25.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.583+0000 7f3d12a00640 1 Processor -- start 2024-08-17T02:47:25.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.583+0000 7f3d12a00640 1 -- start start 2024-08-17T02:47:25.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d12a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3d0c159ca0 0x7f3d0c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d12a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c0ca8a0 0x7f3d0c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d12a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0cadc0 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d12a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cd6e0 con 0x7f3d0c159ca0 2024-08-17T02:47:25.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d12a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0ccf70 con 0x7f3d0c0ca8a0 2024-08-17T02:47:25.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d11600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3d0c159ca0 0x7f3d0c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d11600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3d0c159ca0 0x7f3d0c0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50118/0 (socket says 172.21.15.149:50118) 2024-08-17T02:47:25.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.584+0000 7f3d11600640 1 -- 172.21.15.149:0/2118642465 learned_addr learned my addr 172.21.15.149:0/2118642465 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:25.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.585+0000 7f3d10c00640 1 --2- 172.21.15.149:0/2118642465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c0ca8a0 0x7f3d0c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.585+0000 7f3d11600640 1 -- 172.21.15.149:0/2118642465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c0ca8a0 msgr2=0x7f3d0c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.585+0000 7f3d11600640 1 --2- 172.21.15.149:0/2118642465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c0ca8a0 0x7f3d0c0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.585+0000 7f3d11600640 1 -- 172.21.15.149:0/2118642465 >> v1:172.21.15.161:6789/0 conn(0x7f3d0c0ccad0 legacy=0x7f3d0c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.585+0000 7f3d11600640 1 -- 172.21.15.149:0/2118642465 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0cb060 con 0x7f3d0c159ca0 2024-08-17T02:47:25.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.586+0000 7f3d11600640 1 --2- 172.21.15.149:0/2118642465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c159ca0 0x7f3d0c0ca360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009f20 tx=0x7f3d00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1819938a113ff3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.586+0000 7f3d0be00640 1 -- 172.21.15.149:0/2118642465 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00031400 con 0x7f3d0c159ca0 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.586+0000 7f3d0be00640 1 -- 172.21.15.149:0/2118642465 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0002d050 con 0x7f3d0c159ca0 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.586+0000 7f3d0be00640 1 -- 172.21.15.149:0/2118642465 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000317d0 con 0x7f3d0c159ca0 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 -- 172.21.15.149:0/2118642465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c159ca0 msgr2=0x7f3d0c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2118642465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c159ca0 0x7f3d0c0ca360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009f20 tx=0x7f3d00009840 comp rx=0 tx=0).stop 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 -- 172.21.15.149:0/2118642465 shutdown_connections 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2118642465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c0ca8a0 0x7f3d0c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2118642465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c159ca0 0x7f3d0c0ca360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 -- 172.21.15.149:0/2118642465 >> 172.21.15.149:0/2118642465 conn(0x7f3d0c098e00 msgr2=0x7f3d0c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 -- 172.21.15.149:0/2118642465 shutdown_connections 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.587+0000 7f3d12a00640 1 -- 172.21.15.149:0/2118642465 wait complete. 2024-08-17T02:47:25.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.588+0000 7f3d12a00640 1 Processor -- start 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.588+0000 7f3d12a00640 1 -- start start 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d12a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d0c0ca8a0 0x7f3d0c099770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d12a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 0x7f3d0c0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d12a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c159ca0 0x7f3d0c09b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d12a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c155ba0 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d12a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0c4210 con 0x7f3d0c0ca8a0 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d12a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0c8bf0 con 0x7f3d0c159ca0 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d10c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 0x7f3d0c0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d10c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 0x7f3d0c0c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50132/0 (socket says 172.21.15.149:50132) 2024-08-17T02:47:25.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.589+0000 7f3d10c00640 1 -- 172.21.15.149:0/2395707939 learned_addr learned my addr 172.21.15.149:0/2395707939 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d11600640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d0c0ca8a0 0x7f3d0c099770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d12000640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c159ca0 0x7f3d0c09b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d10c00640 1 -- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c159ca0 msgr2=0x7f3d0c09b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d10c00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c159ca0 0x7f3d0c09b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d10c00640 1 -- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d0c0ca8a0 msgr2=0x7f3d0c099770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d10c00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d0c0ca8a0 0x7f3d0c099770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d10c00640 1 -- 172.21.15.149:0/2395707939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00009ae0 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d10c00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 0x7f3d0c0c9080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800d8c0 tx=0x7f3cf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800de50 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf800b8d0 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c0c3c50 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.590+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800bc70 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.591+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c0c8880 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.591+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c071050 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.592+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3cf8014640 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.593+0000 7f3d08c00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3cec065200 0x7f3cec0676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.593+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3cf8082940 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.593+0000 7f3d11600640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3cec065200 0x7f3cec0676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.594+0000 7f3d11600640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3cec065200 0x7f3cec0676b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3d00033000 tx=0x7f3d00036000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.597+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3cf8050a10 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.771+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d0c0c8d30 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.772+0000 7f3d08c00640 1 -- 172.21.15.149:0/2395707939 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3cf8054030 con 0x7f3d0c0ccad0 2024-08-17T02:47:25.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:25.773 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:25.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3cec065200 msgr2=0x7f3cec0676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3cec065200 0x7f3cec0676b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3d00033000 tx=0x7f3d00036000 comp rx=0 tx=0).stop 2024-08-17T02:47:25.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 msgr2=0x7f3d0c0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 0x7f3d0c0c9080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800d8c0 tx=0x7f3cf8008040 comp rx=0 tx=0).stop 2024-08-17T02:47:25.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 shutdown_connections 2024-08-17T02:47:25.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3cec065200 0x7f3cec0676b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d0c159ca0 0x7f3d0c09b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d0c0ccad0 0x7f3d0c0c9080 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 --2- 172.21.15.149:0/2395707939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d0c0ca8a0 0x7f3d0c099770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 >> 172.21.15.149:0/2395707939 conn(0x7f3d0c098e00 msgr2=0x7f3d0c158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:25.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.774+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 shutdown_connections 2024-08-17T02:47:25.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.775+0000 7f3d12a00640 1 -- 172.21.15.149:0/2395707939 wait complete. 2024-08-17T02:47:25.791 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:47:25.791 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:25.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.940+0000 7f8091400640 1 Processor -- start 2024-08-17T02:47:25.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.940+0000 7f8091400640 1 -- start start 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.941+0000 7f8091400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f808c1401b0 0x7f808c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.941+0000 7f8091400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 0x7f808c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.941+0000 7f8091400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c0caa80 con 0x7f808c140580 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.941+0000 7f8091400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c0cb450 con 0x7f808c1401b0 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.941+0000 7f8091400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0c9e70 con 0x7f808c0b1440 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f808c140580 0x7f808c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45260/0 (socket says 172.21.15.149:45260) 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089e00640 1 -- 172.21.15.149:0/1516003626 learned_addr learned my addr 172.21.15.149:0/1516003626 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f808a800640 1 --2- 172.21.15.149:0/1516003626 >> v2:172.21.15.161:3300/0 conn(0x7f808c1401b0 0x7f808c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f808b200640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 0x7f808c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006832968 0 0) 0x7f808c0caa80 con 0x7f808c140580 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80700034e0 con 0x7f808c140580 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3942051674 0 0) 0x7f80700034e0 con 0x7f808c140580 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 msgr2=0x7f808c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 0x7f808c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 >> v2:172.21.15.161:3300/0 conn(0x7f808c1401b0 msgr2=0x7f808c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 --2- 172.21.15.149:0/1516003626 >> v2:172.21.15.161:3300/0 conn(0x7f808c1401b0 0x7f808c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0ca150 con 0x7f808c140580 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f8078001470 con 0x7f808c140580 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f808a800640 1 --2- 172.21.15.149:0/1516003626 >> v2:172.21.15.161:3300/0 conn(0x7f808c1401b0 0x7f808c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.942+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 >> v1:172.21.15.149:6789/0 conn(0x7f808c140580 legacy=0x7f808c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089400640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80700039d0 0x7f8070003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089400640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f8070004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089400640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 0x7f8070005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0cb450 con 0x7f8070004780 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0c9e70 con 0x7f80700039d0 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807000fde0 con 0x7f808c0b1440 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089e00640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f8070004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f808b200640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 0x7f8070005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f808a800640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80700039d0 0x7f8070003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089e00640 1 -- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 msgr2=0x7f8070005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089e00640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0b1440 0x7f8070005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089e00640 1 -- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80700039d0 msgr2=0x7f8070003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089e00640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80700039d0 0x7f8070003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.943+0000 7f8089e00640 1 -- 172.21.15.149:0/1516003626 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80700034e0 con 0x7f8070004780 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.944+0000 7f8089e00640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f8070004bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f807800c2d0 tx=0x7f8078001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b0b3b4490a05f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078005890 con 0x7f8070004780 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8078005a30 con 0x7f8070004780 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8089400640 1 -- 172.21.15.149:0/1516003626 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078005e30 con 0x7f8070004780 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8091400640 1 -- 172.21.15.149:0/1516003626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 msgr2=0x7f8070004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8091400640 1 --2- 172.21.15.149:0/1516003626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f8070004bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f807800c2d0 tx=0x7f8078001e90 comp rx=0 tx=0).stop 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f808b200640 1 -- 172.21.15.149:0/1516003626 reap_dead start 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8091400640 1 -- 172.21.15.149:0/1516003626 shutdown_connections 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8091400640 1 -- 172.21.15.149:0/1516003626 >> 172.21.15.149:0/1516003626 conn(0x7f808c0cb9b0 msgr2=0x7f808c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8091400640 1 -- 172.21.15.149:0/1516003626 shutdown_connections 2024-08-17T02:47:25.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.945+0000 7f8091400640 1 -- 172.21.15.149:0/1516003626 wait complete. 2024-08-17T02:47:25.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.947+0000 7f8091400640 1 Processor -- start 2024-08-17T02:47:25.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.947+0000 7f8091400640 1 -- start start 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8091400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f808c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8091400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0a8510 0x7f808c0a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8091400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f808c0aa4f0 0x7f808c0aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8091400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0ac350 con 0x7f8070004780 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8091400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0abec0 con 0x7f808c0aa4f0 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8091400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0a8ec0 con 0x7f808c0a8510 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f808c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f808c154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50146/0 (socket says 172.21.15.149:50146) 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 -- 172.21.15.149:0/228309166 learned_addr learned my addr 172.21.15.149:0/228309166 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8089e00640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0a8510 0x7f808c0a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808b200640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f808c0aa4f0 0x7f808c0aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 -- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0a8510 msgr2=0x7f808c0a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0a8510 0x7f808c0a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 -- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f808c0aa4f0 msgr2=0x7f808c0aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f808c0aa4f0 0x7f808c0aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808a800640 1 -- 172.21.15.149:0/228309166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0ab2b0 con 0x7f8070004780 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f808b200640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f808c0aa4f0 0x7f808c0aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.948+0000 7f8089e00640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0a8510 0x7f808c0a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.949+0000 7f808a800640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f808c154690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f807c011d70 tx=0x7f807c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.949+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00fec0 con 0x7f8070004780 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.949+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c011e70 con 0x7f8070004780 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.949+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c014650 con 0x7f8070004780 2024-08-17T02:47:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.949+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c0ab590 con 0x7f8070004780 2024-08-17T02:47:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.949+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c0abb50 con 0x7f8070004780 2024-08-17T02:47:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.950+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c064db0 con 0x7f8070004780 2024-08-17T02:47:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.951+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f807c014a40 con 0x7f8070004780 2024-08-17T02:47:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.952+0000 7f8082000640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f806c065150 0x7f806c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.952+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f807c018030 con 0x7f8070004780 2024-08-17T02:47:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.952+0000 7f8089e00640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f806c065150 0x7f806c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.953+0000 7f8089e00640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f806c065150 0x7f806c067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8078033000 tx=0x7f8078034000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:25.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:25.956+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f807c051150 con 0x7f8070004780 2024-08-17T02:47:26.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.164+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f808c0b0ff0 con 0x7f8070004780 2024-08-17T02:47:26.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.164+0000 7f8082000640 1 -- 172.21.15.149:0/228309166 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f807c022090 con 0x7f8070004780 2024-08-17T02:47:26.165 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:26.165 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:26.166 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:26.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f806c065150 msgr2=0x7f806c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f806c065150 0x7f806c067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8078033000 tx=0x7f8078034000 comp rx=0 tx=0).stop 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 msgr2=0x7f808c154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f808c154690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f807c011d70 tx=0x7f807c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 shutdown_connections 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f806c065150 0x7f806c067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f808c0aa4f0 0x7f808c0aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f808c0a8510 0x7f808c0a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 --2- 172.21.15.149:0/228309166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8070004780 0x7f808c154690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 >> 172.21.15.149:0/228309166 conn(0x7f808c0cb9b0 msgr2=0x7f808c0b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 shutdown_connections 2024-08-17T02:47:26.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.167+0000 7f8091400640 1 -- 172.21.15.149:0/228309166 wait complete. 2024-08-17T02:47:26.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:26.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.334+0000 7fb061a00640 1 Processor -- start 2024-08-17T02:47:26.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.334+0000 7fb061a00640 1 -- start start 2024-08-17T02:47:26.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb061a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155df0 0x7fb05c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb061a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c156670 con 0x7fb05c06df00 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb061a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06e5e0 con 0x7fb05c155a20 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb061a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0b0350 con 0x7fb05c155df0 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb052000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb05c06df00 0x7fb05c156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45262/0 (socket says 172.21.15.149:45262) 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb052000640 1 -- 172.21.15.149:0/124351663 learned_addr learned my addr 172.21.15.149:0/124351663 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb05b400640 1 --2- 172.21.15.149:0/124351663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155df0 0x7fb05c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360051066 0 0) 0x7fb05c156670 con 0x7fb05c06df00 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.336+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0400034e0 con 0x7fb05c06df00 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.337+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900778696 0 0) 0x7fb05c06e5e0 con 0x7fb05c155a20 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.337+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb05c156670 con 0x7fb05c155a20 2024-08-17T02:47:26.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.337+0000 7fb05b400640 1 -- 172.21.15.149:0/124351663 >> v1:172.21.15.161:6789/0 conn(0x7fb05c155a20 legacy=0x7fb05c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.337+0000 7fb05b400640 1 -- 172.21.15.149:0/124351663 >> v1:172.21.15.149:6789/0 conn(0x7fb05c06df00 legacy=0x7fb05c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.337+0000 7fb05b400640 1 -- 172.21.15.149:0/124351663 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c06e8c0 con 0x7fb05c155df0 2024-08-17T02:47:26.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.338+0000 7fb05b400640 1 --2- 172.21.15.149:0/124351663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155df0 0x7fb05c0adf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb054009e90 tx=0x7fb054009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d167c8a0a3b4f70 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.338+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054007550 con 0x7fb05c155df0 2024-08-17T02:47:26.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.338+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05402d050 con 0x7fb05c155df0 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.338+0000 7fb05a000640 1 -- 172.21.15.149:0/124351663 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540078e0 con 0x7fb05c155df0 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 -- 172.21.15.149:0/124351663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155df0 msgr2=0x7fb05c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 --2- 172.21.15.149:0/124351663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155df0 0x7fb05c0adf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb054009e90 tx=0x7fb054009780 comp rx=0 tx=0).stop 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 -- 172.21.15.149:0/124351663 shutdown_connections 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 --2- 172.21.15.149:0/124351663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155df0 0x7fb05c0adf10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 -- 172.21.15.149:0/124351663 >> 172.21.15.149:0/124351663 conn(0x7fb05c0cb9b0 msgr2=0x7fb05c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 -- 172.21.15.149:0/124351663 shutdown_connections 2024-08-17T02:47:26.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.339+0000 7fb061a00640 1 -- 172.21.15.149:0/124351663 wait complete. 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.340+0000 7fb061a00640 1 Processor -- start 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.340+0000 7fb061a00640 1 -- start start 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.341+0000 7fb061a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb05c06df00 0x7fb05c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.341+0000 7fb061a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155a20 0x7fb05c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.341+0000 7fb061a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 0x7fb05c14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.341+0000 7fb061a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c14e3d0 con 0x7fb05c155df0 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.341+0000 7fb061a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c14e650 con 0x7fb05c06df00 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.341+0000 7fb061a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c14e930 con 0x7fb05c155a20 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 0x7fb05c14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 0x7fb05c14c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50156/0 (socket says 172.21.15.149:50156) 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 -- 172.21.15.149:0/3454391918 learned_addr learned my addr 172.21.15.149:0/3454391918 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb052000640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155a20 0x7fb05c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05aa00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb05c06df00 0x7fb05c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 -- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155a20 msgr2=0x7fb05c14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155a20 0x7fb05c14de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 -- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb05c06df00 msgr2=0x7fb05c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb05c06df00 0x7fb05c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 -- 172.21.15.149:0/3454391918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054009a20 con 0x7fb05c155df0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb052000640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155a20 0x7fb05c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05aa00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb05c06df00 0x7fb05c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.342+0000 7fb05b400640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 0x7fb05c14c340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb054009de0 tx=0x7fb054037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.343+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054031ac0 con 0x7fb05c155df0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.343+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb054031c20 con 0x7fb05c155df0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.343+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05403c420 con 0x7fb05c155df0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.343+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c14ec10 con 0x7fb05c155df0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.343+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c14f1d0 con 0x7fb05c155df0 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.344+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05c14f3c0 con 0x7fb05c155df0 2024-08-17T02:47:26.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.345+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb05403c830 con 0x7fb05c155df0 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.346+0000 7fb052a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb038065150 0x7fb038067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.346+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0540a3540 con 0x7fb05c155df0 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.346+0000 7fb05aa00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb038065150 0x7fb038067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.347+0000 7fb05aa00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb038065150 0x7fb038067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb04c007fd0 tx=0x7fb04c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.350+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb054071560 con 0x7fb05c155df0 2024-08-17T02:47:26.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.556+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb05c064db0 con 0x7fb05c155df0 2024-08-17T02:47:26.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.557+0000 7fb052a00640 1 -- 172.21.15.149:0/3454391918 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fb054074b80 con 0x7fb05c155df0 2024-08-17T02:47:26.558 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:26.558 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3208377410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3208377410},{"type":"v1","addr":"172.21.15.161:6834","nonce":3208377410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/319205286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":319205286},{"type":"v1","addr":"172.21.15.149:6837","nonce":319205286}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2325571464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2325571464},{"type":"v1","addr":"172.21.15.161:6835","nonce":2325571464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:48.469804+0000","modified":"2024-08-17T02:46:52.087128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/4028834101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4028834101},{"type":"v1","addr":"172.21.15.149:6835","nonce":4028834101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 8 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb038065150 msgr2=0x7fb038067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb038065150 0x7fb038067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb04c007fd0 tx=0x7fb04c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 msgr2=0x7fb05c14c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 0x7fb05c14c340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb054009de0 tx=0x7fb054037000 comp rx=0 tx=0).stop 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 shutdown_connections 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb038065150 0x7fb038067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05c155df0 0x7fb05c14c340 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb05c155a20 0x7fb05c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 --2- 172.21.15.149:0/3454391918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb05c06df00 0x7fb05c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 >> 172.21.15.149:0/3454391918 conn(0x7fb05c0cb9b0 msgr2=0x7fb05c157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 shutdown_connections 2024-08-17T02:47:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.559+0000 7fb061a00640 1 -- 172.21.15.149:0/3454391918 wait complete. 2024-08-17T02:47:26.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.724+0000 7fe5d9a00640 1 Processor -- start 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.724+0000 7fe5d9a00640 1 -- start start 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d9a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d9a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5d4140580 0x7fe5d40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d9a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe5d40b1270 0x7fe5d40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d9a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d40cb450 con 0x7fe5d4140580 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d9a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d40b16d0 con 0x7fe5d40b1270 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d9a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40caa80 con 0x7fe5d41401b0 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.725+0000 7fe5d2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5d4140580 0x7fe5d40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5d4140580 0x7fe5d40b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50170/0 (socket says 172.21.15.149:50170) 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 -- 172.21.15.149:0/889308500 learned_addr learned my addr 172.21.15.149:0/889308500 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d3400640 1 --2- 172.21.15.149:0/889308500 >> v2:172.21.15.161:3300/0 conn(0x7fe5d40b1270 0x7fe5d40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2a00640 1 --2- 172.21.15.149:0/889308500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 -- 172.21.15.149:0/889308500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 msgr2=0x7fe5d40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 --2- 172.21.15.149:0/889308500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 -- 172.21.15.149:0/889308500 >> v2:172.21.15.161:3300/0 conn(0x7fe5d40b1270 msgr2=0x7fe5d40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 --2- 172.21.15.149:0/889308500 >> v2:172.21.15.161:3300/0 conn(0x7fe5d40b1270 0x7fe5d40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d2000640 1 -- 172.21.15.149:0/889308500 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40c9e70 con 0x7fe5d4140580 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.726+0000 7fe5d3400640 1 --2- 172.21.15.149:0/889308500 >> v2:172.21.15.161:3300/0 conn(0x7fe5d40b1270 0x7fe5d40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.727+0000 7fe5d2000640 1 --2- 172.21.15.149:0/889308500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d40b0d30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40acbc0 tx=0x7fe5c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbed23d34c0067b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.727+0000 7fe5d1600640 1 -- 172.21.15.149:0/889308500 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c002ad40 con 0x7fe5d4140580 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.727+0000 7fe5d1600640 1 -- 172.21.15.149:0/889308500 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0032440 con 0x7fe5d4140580 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.727+0000 7fe5d1600640 1 -- 172.21.15.149:0/889308500 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c002aea0 con 0x7fe5d4140580 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 -- 172.21.15.149:0/889308500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 msgr2=0x7fe5d40b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/889308500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d40b0d30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40acbc0 tx=0x7fe5c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 -- 172.21.15.149:0/889308500 shutdown_connections 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/889308500 >> v2:172.21.15.161:3300/0 conn(0x7fe5d40b1270 0x7fe5d40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/889308500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d40b0d30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/889308500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 -- 172.21.15.149:0/889308500 >> 172.21.15.149:0/889308500 conn(0x7fe5d40cb9b0 msgr2=0x7fe5d40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 -- 172.21.15.149:0/889308500 shutdown_connections 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.728+0000 7fe5d9a00640 1 -- 172.21.15.149:0/889308500 wait complete. 2024-08-17T02:47:26.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.729+0000 7fe5d9a00640 1 Processor -- start 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.729+0000 7fe5d9a00640 1 -- start start 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d9a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5d40b1270 0x7fe5d4133150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d9a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d4158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d9a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40aa720 con 0x7fe5d4140580 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d9a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40b0b10 con 0x7fe5d40b1270 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d9a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40b0550 con 0x7fe5d41401b0 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.730+0000 7fe5d3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d4158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d4158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:50186/0 (socket says 172.21.15.149:50186) 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 -- 172.21.15.149:0/2777595666 learned_addr learned my addr 172.21.15.149:0/2777595666 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d2a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5d40b1270 0x7fe5d4133150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d2000640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 -- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 msgr2=0x7fe5d40afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 -- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5d40b1270 msgr2=0x7fe5d4133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5d40b1270 0x7fe5d4133150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 -- 172.21.15.149:0/2777595666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0009450 con 0x7fe5d4140580 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5d3400640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d4158b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009fc0 tx=0x7fe5cc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.731+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00de80 con 0x7fe5d4140580 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.732+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc00f040 con 0x7fe5d4140580 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.732+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d40b0830 con 0x7fe5d4140580 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.732+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc015690 con 0x7fe5d4140580 2024-08-17T02:47:26.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.732+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d41580c0 con 0x7fe5d4140580 2024-08-17T02:47:26.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.733+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d40aa890 con 0x7fe5d4140580 2024-08-17T02:47:26.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.733+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe5cc01e3b0 con 0x7fe5d4140580 2024-08-17T02:47:26.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.734+0000 7fe5ca000640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe5b4065150 0x7fe5b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.735 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.734+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5cc0829e0 con 0x7fe5d4140580 2024-08-17T02:47:26.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.735+0000 7fe5d2a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe5b4065150 0x7fe5b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.735+0000 7fe5d2a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe5b4065150 0x7fe5b4067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4007b10 tx=0x7fe5c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.738+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5cc050ab0 con 0x7fe5d4140580 2024-08-17T02:47:26.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.912+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5d4064db0 con 0x7fe5d4140580 2024-08-17T02:47:26.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.913+0000 7fe5ca000640 1 -- 172.21.15.149:0/2777595666 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe5cc01f440 con 0x7fe5d4140580 2024-08-17T02:47:26.914 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:26.914 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:46:50.072193+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:46.862390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:47.456535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:26.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe5b4065150 msgr2=0x7fe5b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe5b4065150 0x7fe5b4067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4007b10 tx=0x7fe5c4008040 comp rx=0 tx=0).stop 2024-08-17T02:47:26.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 msgr2=0x7fe5d4158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d4158b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009fc0 tx=0x7fe5cc0099b0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 shutdown_connections 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fe5b4065150 0x7fe5b4067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5d4140580 0x7fe5d4158b60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5d41401b0 0x7fe5d40afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 --2- 172.21.15.149:0/2777595666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5d40b1270 0x7fe5d4133150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.915+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 >> 172.21.15.149:0/2777595666 conn(0x7fe5d40cb9b0 msgr2=0x7fe5d406dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.916+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 shutdown_connections 2024-08-17T02:47:26.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:26.916+0000 7fe5d9a00640 1 -- 172.21.15.149:0/2777595666 wait complete. 2024-08-17T02:47:26.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:47:27.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.081+0000 7f438c000640 1 Processor -- start 2024-08-17T02:47:27.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.081+0000 7f438c000640 1 -- start start 2024-08-17T02:47:27.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438c000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43840b1440 0x7f43840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438c000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4384140580 0x7f43840c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438c000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43840caa80 con 0x7f43841401b0 2024-08-17T02:47:27.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438c000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43840cb450 con 0x7f4384140580 2024-08-17T02:47:27.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438c000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43840c9e70 con 0x7f43840b1440 2024-08-17T02:47:27.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f4389600640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f43841401b0 0x7f43840b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50742/0 (socket says 172.21.15.149:50742) 2024-08-17T02:47:27.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f4389600640 1 -- 172.21.15.149:0/473647829 learned_addr learned my addr 172.21.15.149:0/473647829 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:27.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438a000640 1 --2- 172.21.15.149:0/473647829 >> v2:172.21.15.149:3300/0 conn(0x7f4384140580 0x7f43840c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438a000640 1 -- 172.21.15.149:0/473647829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43840b1440 msgr2=0x7f43840caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438a000640 1 --2- 172.21.15.149:0/473647829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43840b1440 0x7f43840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438a000640 1 -- 172.21.15.149:0/473647829 >> v1:172.21.15.149:6789/0 conn(0x7f43841401b0 legacy=0x7f43840b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.083+0000 7f438a000640 1 -- 172.21.15.149:0/473647829 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43840ca150 con 0x7f4384140580 2024-08-17T02:47:27.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.084+0000 7f438a000640 1 --2- 172.21.15.149:0/473647829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4384140580 0x7f43840c9040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f437c009850 tx=0x7f437c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f5503d9efb024e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f4383e00640 1 -- 172.21.15.149:0/473647829 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c02ad90 con 0x7f4384140580 2024-08-17T02:47:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f4383e00640 1 -- 172.21.15.149:0/473647829 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c032440 con 0x7f4384140580 2024-08-17T02:47:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f4383e00640 1 -- 172.21.15.149:0/473647829 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c032820 con 0x7f4384140580 2024-08-17T02:47:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 -- 172.21.15.149:0/473647829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4384140580 msgr2=0x7f43840c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 --2- 172.21.15.149:0/473647829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4384140580 0x7f43840c9040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f437c009850 tx=0x7f437c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 -- 172.21.15.149:0/473647829 shutdown_connections 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 --2- 172.21.15.149:0/473647829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4384140580 0x7f43840c9040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 --2- 172.21.15.149:0/473647829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43840b1440 0x7f43840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 -- 172.21.15.149:0/473647829 >> 172.21.15.149:0/473647829 conn(0x7f43840cb9b0 msgr2=0x7f43840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 -- 172.21.15.149:0/473647829 shutdown_connections 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.085+0000 7f438c000640 1 -- 172.21.15.149:0/473647829 wait complete. 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.087+0000 7f438c000640 1 Processor -- start 2024-08-17T02:47:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.087+0000 7f438c000640 1 -- start start 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438c000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43840b1440 0x7f4384169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 0x7f43840c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438c000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4384140580 0x7f438415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43840c6ff0 con 0x7f43841401b0 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438c000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438416a2f0 con 0x7f43840b1440 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438c000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438415b070 con 0x7f4384140580 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 0x7f43840c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 0x7f43840c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55146/0 (socket says 172.21.15.149:55146) 2024-08-17T02:47:27.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 -- 172.21.15.149:0/4042573086 learned_addr learned my addr 172.21.15.149:0/4042573086 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4389600640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43840b1440 0x7f4384169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f438a000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4384140580 0x7f438415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 -- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4384140580 msgr2=0x7f438415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4384140580 0x7f438415ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 -- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43840b1440 msgr2=0x7f4384169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43840b1440 0x7f4384169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.088+0000 7f4388c00640 1 -- 172.21.15.149:0/4042573086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c009390 con 0x7f43841401b0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.089+0000 7f4388c00640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 0x7f43840c6ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f437000b5e0 tx=0x7f4370009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.089+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000f590 con 0x7f43841401b0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.089+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437000f6f0 con 0x7f43841401b0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.089+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000fab0 con 0x7f43841401b0 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.089+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43840c7210 con 0x7f43841401b0 2024-08-17T02:47:27.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.089+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43840c77d0 con 0x7f43841401b0 2024-08-17T02:47:27.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.090+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438416a460 con 0x7f43841401b0 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.091+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f437001a460 con 0x7f43841401b0 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.092+0000 7f4380c00640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4364065150 0x7f4364067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.092+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4370082000 con 0x7f43841401b0 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.092+0000 7f4389600640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4364065150 0x7f4364067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.093+0000 7f4389600640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4364065150 0x7f4364067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4378004fd0 tx=0x7f4378001a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.096+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43700501f0 con 0x7f43841401b0 2024-08-17T02:47:27.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.306+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4384064db0 con 0x7f43841401b0 2024-08-17T02:47:27.307 INFO:tasks.ceph.mon.a.smithi149.stderr:2024-08-17T02:47:27.307+0000 7fa0b9600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:47:27.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.313+0000 7f4380c00640 1 -- 172.21.15.149:0/4042573086 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4370053810 con 0x7f43841401b0 2024-08-17T02:47:27.313 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:47:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4364065150 msgr2=0x7f4364067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4364065150 0x7f4364067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4378004fd0 tx=0x7f4378001a10 comp rx=0 tx=0).stop 2024-08-17T02:47:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 msgr2=0x7f43840c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 0x7f43840c6ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f437000b5e0 tx=0x7f4370009120 comp rx=0 tx=0).stop 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 shutdown_connections 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4364065150 0x7f4364067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4384140580 0x7f438415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43841401b0 0x7f43840c6ab0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 --2- 172.21.15.149:0/4042573086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43840b1440 0x7f4384169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.315+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 >> 172.21.15.149:0/4042573086 conn(0x7f43840cb9b0 msgr2=0x7f43840b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.316+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 shutdown_connections 2024-08-17T02:47:27.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.316+0000 7f438c000640 1 -- 172.21.15.149:0/4042573086 wait complete. 2024-08-17T02:47:27.319 INFO:tasks.ceph.mds.a.smithi149.stderr: -2019> 2024-08-17T02:46:52.027+0000 7f7e0ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:27.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:47:27.358 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2024-08-17T02:47:27.485 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.485+0000 7fae42800640 1 Processor -- start 2024-08-17T02:47:27.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.485+0000 7fae42800640 1 -- start start 2024-08-17T02:47:27.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.486+0000 7fae42800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0ab3c0 0x7fae3c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.486+0000 7fae42800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae3c0a98e0 0x7fae3c06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.486+0000 7fae42800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0ac4d0 con 0x7fae3c158c70 2024-08-17T02:47:27.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.486+0000 7fae42800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0ad070 con 0x7fae3c0a98e0 2024-08-17T02:47:27.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.486+0000 7fae42800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0ab8c0 con 0x7fae3c0ab3c0 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae3c0a98e0 0x7fae3c06dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3b400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fae3c158c70 0x7fae3c0ac960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50758/0 (socket says 172.21.15.149:50758) 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3b400640 1 -- 172.21.15.149:0/3804032462 learned_addr learned my addr 172.21.15.149:0/3804032462 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3aa00640 1 --2- 172.21.15.149:0/3804032462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0ab3c0 0x7fae3c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3be00640 1 -- 172.21.15.149:0/3804032462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0ab3c0 msgr2=0x7fae3c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3be00640 1 --2- 172.21.15.149:0/3804032462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0ab3c0 0x7fae3c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3be00640 1 -- 172.21.15.149:0/3804032462 >> v1:172.21.15.149:6789/0 conn(0x7fae3c158c70 legacy=0x7fae3c0ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3be00640 1 -- 172.21.15.149:0/3804032462 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0abba0 con 0x7fae3c0a98e0 2024-08-17T02:47:27.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.487+0000 7fae3a000640 1 -- 172.21.15.149:0/3804032462 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360238767 0 0) 0x7fae3c0ac4d0 con 0x7fae3c158c70 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.488+0000 7fae3be00640 1 --2- 172.21.15.149:0/3804032462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c0a98e0 0x7fae3c06dcf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae34009e60 tx=0x7fae34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d85b00d71be3986 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.488+0000 7fae3a000640 1 -- 172.21.15.149:0/3804032462 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34007550 con 0x7fae3c0a98e0 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.488+0000 7fae3a000640 1 -- 172.21.15.149:0/3804032462 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3402d050 con 0x7fae3c0a98e0 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.488+0000 7fae3a000640 1 -- 172.21.15.149:0/3804032462 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340078e0 con 0x7fae3c0a98e0 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 -- 172.21.15.149:0/3804032462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c0a98e0 msgr2=0x7fae3c06dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 --2- 172.21.15.149:0/3804032462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c0a98e0 0x7fae3c06dcf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae34009e60 tx=0x7fae34009780 comp rx=0 tx=0).stop 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 -- 172.21.15.149:0/3804032462 shutdown_connections 2024-08-17T02:47:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 --2- 172.21.15.149:0/3804032462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c0a98e0 0x7fae3c06dcf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 --2- 172.21.15.149:0/3804032462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0ab3c0 0x7fae3c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 -- 172.21.15.149:0/3804032462 >> 172.21.15.149:0/3804032462 conn(0x7fae3c067750 msgr2=0x7fae3c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 -- 172.21.15.149:0/3804032462 shutdown_connections 2024-08-17T02:47:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.489+0000 7fae42800640 1 -- 172.21.15.149:0/3804032462 wait complete. 2024-08-17T02:47:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.490+0000 7fae42800640 1 Processor -- start 2024-08-17T02:47:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.491+0000 7fae42800640 1 -- start start 2024-08-17T02:47:27.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.491+0000 7fae42800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0a98e0 0x7fae3c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.491+0000 7fae42800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae3c0ab3c0 0x7fae3c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae42800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 0x7fae3c16bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae42800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c153b50 con 0x7fae3c158c70 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae42800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c151a50 con 0x7fae3c0ab3c0 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae42800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c152ed0 con 0x7fae3c0a98e0 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 0x7fae3c16bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 0x7fae3c16bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55184/0 (socket says 172.21.15.149:55184) 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 -- 172.21.15.149:0/3866841177 learned_addr learned my addr 172.21.15.149:0/3866841177 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3b400640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0a98e0 0x7fae3c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3aa00640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae3c0ab3c0 0x7fae3c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 -- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0a98e0 msgr2=0x7fae3c15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0a98e0 0x7fae3c15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 -- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae3c0ab3c0 msgr2=0x7fae3c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae3c0ab3c0 0x7fae3c15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3be00640 1 -- 172.21.15.149:0/3866841177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009a20 con 0x7fae3c158c70 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.492+0000 7fae3aa00640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae3c0ab3c0 0x7fae3c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.493+0000 7fae3be00640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 0x7fae3c16bbc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae340099f0 tx=0x7fae34037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.493+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34031a00 con 0x7fae3c158c70 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.493+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34040070 con 0x7fae3c158c70 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.493+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34031db0 con 0x7fae3c158c70 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.493+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c1531b0 con 0x7fae3c158c70 2024-08-17T02:47:27.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.493+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c153770 con 0x7fae3c158c70 2024-08-17T02:47:27.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.494+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0afbd0 con 0x7fae3c158c70 2024-08-17T02:47:27.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.495+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fae34042030 con 0x7fae3c158c70 2024-08-17T02:47:27.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.495+0000 7fae32a00640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fae1c065150 0x7fae1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.496+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fae340a3ef0 con 0x7fae3c158c70 2024-08-17T02:47:27.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.496+0000 7fae3b400640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fae1c065150 0x7fae1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.496+0000 7fae3b400640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fae1c065150 0x7fae1c067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c870 tx=0x7fae2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.500+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fae3c0afbd0 con 0x7fae3c158c70 2024-08-17T02:47:27.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:27.714+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae3c153010 con 0x7fae3c158c70 2024-08-17T02:47:28.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.324+0000 7fae32a00640 1 -- 172.21.15.149:0/3866841177 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae3c153010 con 0x7fae3c158c70 2024-08-17T02:47:28.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.328+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fae1c065150 msgr2=0x7fae1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.328+0000 7fae42800640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fae1c065150 0x7fae1c067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c870 tx=0x7fae2c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:28.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.328+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 msgr2=0x7fae3c16bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.328+0000 7fae42800640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 0x7fae3c16bbc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae340099f0 tx=0x7fae34037000 comp rx=0 tx=0).stop 2024-08-17T02:47:28.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 shutdown_connections 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fae1c065150 0x7fae1c067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c158c70 0x7fae3c16bbc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae3c0ab3c0 0x7fae3c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 --2- 172.21.15.149:0/3866841177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3c0a98e0 0x7fae3c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 >> 172.21.15.149:0/3866841177 conn(0x7fae3c067750 msgr2=0x7fae3c15f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 shutdown_connections 2024-08-17T02:47:28.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.329+0000 7fae42800640 1 -- 172.21.15.149:0/3866841177 wait complete. 2024-08-17T02:47:28.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:47:28.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.541+0000 7fbfa1000640 1 Processor -- start 2024-08-17T02:47:28.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.541+0000 7fbfa1000640 1 -- start start 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbfa1000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf9c158da0 0x7fbf9c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbfa1000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c066cd0 con 0x7fbf9c15cd30 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbfa1000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c15d160 con 0x7fbf9c1589d0 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbfa1000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c15d5e0 con 0x7fbf9c158da0 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbf9be00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbf9c15cd30 0x7fbf9c067160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50762/0 (socket says 172.21.15.149:50762) 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbf9be00640 1 -- 172.21.15.149:0/1710962290 learned_addr learned my addr 172.21.15.149:0/1710962290 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:28.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.542+0000 7fbf92a00640 1 --2- 172.21.15.149:0/1710962290 >> v2:172.21.15.161:3300/0 conn(0x7fbf9c158da0 0x7fbf9c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.543+0000 7fbf9aa00640 1 -- 172.21.15.149:0/1710962290 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834876735 0 0) 0x7fbf9c066cd0 con 0x7fbf9c15cd30 2024-08-17T02:47:28.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.543+0000 7fbf9aa00640 1 -- 172.21.15.149:0/1710962290 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf800034e0 con 0x7fbf9c15cd30 2024-08-17T02:47:28.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.543+0000 7fbf92a00640 1 -- 172.21.15.149:0/1710962290 >> v1:172.21.15.161:6789/0 conn(0x7fbf9c1589d0 legacy=0x7fbf9c06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.543+0000 7fbf92a00640 1 -- 172.21.15.149:0/1710962290 >> v1:172.21.15.149:6789/0 conn(0x7fbf9c15cd30 legacy=0x7fbf9c067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.543+0000 7fbf92a00640 1 -- 172.21.15.149:0/1710962290 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c06d8d0 con 0x7fbf9c158da0 2024-08-17T02:47:28.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.544+0000 7fbf92a00640 1 --2- 172.21.15.149:0/1710962290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c15c7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009850 tx=0x7fbf840090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43cb237c0be201fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbf9aa00640 1 -- 172.21.15.149:0/1710962290 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8402ad90 con 0x7fbf9c158da0 2024-08-17T02:47:28.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbf9aa00640 1 -- 172.21.15.149:0/1710962290 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84032440 con 0x7fbf9c158da0 2024-08-17T02:47:28.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbf9aa00640 1 -- 172.21.15.149:0/1710962290 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840327e0 con 0x7fbf9c158da0 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 -- 172.21.15.149:0/1710962290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 msgr2=0x7fbf9c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1710962290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c15c7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009850 tx=0x7fbf840090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 -- 172.21.15.149:0/1710962290 shutdown_connections 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1710962290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c15c7f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 -- 172.21.15.149:0/1710962290 >> 172.21.15.149:0/1710962290 conn(0x7fbf9c0cca90 msgr2=0x7fbf9c0a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 -- 172.21.15.149:0/1710962290 shutdown_connections 2024-08-17T02:47:28.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.545+0000 7fbfa1000640 1 -- 172.21.15.149:0/1710962290 wait complete. 2024-08-17T02:47:28.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.547+0000 7fbfa1000640 1 Processor -- start 2024-08-17T02:47:28.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.547+0000 7fbfa1000640 1 -- start start 2024-08-17T02:47:28.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbfa1000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf9c1589d0 0x7fbf9c1699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbfa1000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbfa1000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 0x7fbf9c098e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbfa1000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c169ee0 con 0x7fbf9c15cd30 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbfa1000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0989a0 con 0x7fbf9c158da0 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbfa1000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c097d90 con 0x7fbf9c1589d0 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbf9be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 0x7fbf9c098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbf9be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 0x7fbf9c098e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55190/0 (socket says 172.21.15.149:55190) 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbf9be00640 1 -- 172.21.15.149:0/1356959889 learned_addr learned my addr 172.21.15.149:0/1356959889 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbf9b400640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf9c1589d0 0x7fbf9c1699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbf92a00640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.548+0000 7fbf9be00640 1 -- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf9c1589d0 msgr2=0x7fbf9c1699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf9be00640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf9c1589d0 0x7fbf9c1699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf9be00640 1 -- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 msgr2=0x7fbf9c1479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf9be00640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c1479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf9be00640 1 -- 172.21.15.149:0/1356959889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009390 con 0x7fbf9c15cd30 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf9be00640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 0x7fbf9c098e30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf94001460 tx=0x7fbf94001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400ce30 con 0x7fbf9c15cd30 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9400a850 con 0x7fbf9c15cd30 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400ac50 con 0x7fbf9c15cd30 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c098070 con 0x7fbf9c15cd30 2024-08-17T02:47:28.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.549+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c098630 con 0x7fbf9c15cd30 2024-08-17T02:47:28.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.550+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c098b30 con 0x7fbf9c15cd30 2024-08-17T02:47:28.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.551+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf94007300 con 0x7fbf9c15cd30 2024-08-17T02:47:28.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.553+0000 7fbf93400640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbf78065180 0x7fbf78067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.553+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5907+0+0 (secure 0 0 0) 0x7fbf94082640 con 0x7fbf9c15cd30 2024-08-17T02:47:28.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.553+0000 7fbf9b400640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbf78065180 0x7fbf78067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.553+0000 7fbf9b400640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbf78065180 0x7fbf78067630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c007fd0 tx=0x7fbf8c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.557+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf94050630 con 0x7fbf9c15cd30 2024-08-17T02:47:28.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:28.734+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf9c071050 con 0x7fbf9c15cd30 2024-08-17T02:47:29.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.323+0000 7fbf93400640 1 -- 172.21.15.149:0/1356959889 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbf94053c50 con 0x7fbf9c15cd30 2024-08-17T02:47:29.324 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:47:29.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbf78065180 msgr2=0x7fbf78067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbf78065180 0x7fbf78067630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c007fd0 tx=0x7fbf8c007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:29.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 msgr2=0x7fbf9c098e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 0x7fbf9c098e30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf94001460 tx=0x7fbf94001a40 comp rx=0 tx=0).stop 2024-08-17T02:47:29.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 shutdown_connections 2024-08-17T02:47:29.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbf78065180 0x7fbf78067630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9c15cd30 0x7fbf9c098e30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c158da0 0x7fbf9c1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 --2- 172.21.15.149:0/1356959889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf9c1589d0 0x7fbf9c1699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.328+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 >> 172.21.15.149:0/1356959889 conn(0x7fbf9c0cca90 msgr2=0x7fbf9c156c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.329+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 shutdown_connections 2024-08-17T02:47:29.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.329+0000 7fbfa1000640 1 -- 172.21.15.149:0/1356959889 wait complete. 2024-08-17T02:47:29.347 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:47:29.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.498+0000 7f9d5fe00640 1 Processor -- start 2024-08-17T02:47:29.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.498+0000 7f9d5fe00640 1 -- start start 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9d60155880 0x7f9d600ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d600aeb70 0x7f9d600af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5fe00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d60157840 con 0x7f9d60155c50 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d60156c30 con 0x7f9d60155880 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5fe00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d60156f10 con 0x7f9d600aeb70 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9d60155880 0x7f9d600ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9d60155880 0x7f9d600ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55200/0 (socket says 172.21.15.149:55200) 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d5ea00640 1 -- 172.21.15.149:0/2748671046 learned_addr learned my addr 172.21.15.149:0/2748671046 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:29.501 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.500+0000 7f9d56000640 1 --2- 172.21.15.149:0/2748671046 >> v2:172.21.15.161:3300/0 conn(0x7f9d600aeb70 0x7f9d600af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.501+0000 7f9d5ea00640 1 -- 172.21.15.149:0/2748671046 >> v2:172.21.15.161:3300/0 conn(0x7f9d600aeb70 msgr2=0x7f9d600af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:29.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.501+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/2748671046 >> v2:172.21.15.161:3300/0 conn(0x7f9d600aeb70 0x7f9d600af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.501+0000 7f9d5ea00640 1 -- 172.21.15.149:0/2748671046 >> v1:172.21.15.161:6789/0 conn(0x7f9d60155c50 legacy=0x7f9d601596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.501+0000 7f9d5ea00640 1 -- 172.21.15.149:0/2748671046 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d601571f0 con 0x7f9d60155880 2024-08-17T02:47:29.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.502+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/2748671046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d60155880 0x7f9d600ae630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d600682e0 tx=0x7f9d5000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde31cb75b5ba7a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.502+0000 7f9d5e000640 1 -- 172.21.15.149:0/2748671046 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50031650 con 0x7f9d60155880 2024-08-17T02:47:29.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.502+0000 7f9d5e000640 1 -- 172.21.15.149:0/2748671046 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d500317b0 con 0x7f9d60155880 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.502+0000 7f9d5e000640 1 -- 172.21.15.149:0/2748671046 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50031b90 con 0x7f9d60155880 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 -- 172.21.15.149:0/2748671046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d60155880 msgr2=0x7f9d600ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/2748671046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d60155880 0x7f9d600ae630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d600682e0 tx=0x7f9d5000b460 comp rx=0 tx=0).stop 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 -- 172.21.15.149:0/2748671046 shutdown_connections 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/2748671046 >> v2:172.21.15.161:3300/0 conn(0x7f9d600aeb70 0x7f9d600af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/2748671046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d60155880 0x7f9d600ae630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 -- 172.21.15.149:0/2748671046 >> 172.21.15.149:0/2748671046 conn(0x7f9d60067750 msgr2=0x7f9d600cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 -- 172.21.15.149:0/2748671046 shutdown_connections 2024-08-17T02:47:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.503+0000 7f9d5fe00640 1 -- 172.21.15.149:0/2748671046 wait complete. 2024-08-17T02:47:29.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.504+0000 7f9d5fe00640 1 Processor -- start 2024-08-17T02:47:29.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.504+0000 7f9d5fe00640 1 -- start start 2024-08-17T02:47:29.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.505+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 0x7f9d6015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d60155880 0x7f9d6013c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d60155c50 0x7f9d60150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015acb0 con 0x7f9d600aeb70 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5fe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015f000 con 0x7f9d60155880 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5fe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015ea40 con 0x7f9d60155c50 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 0x7f9d6015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 0x7f9d6015a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55214/0 (socket says 172.21.15.149:55214) 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 -- 172.21.15.149:0/68186355 learned_addr learned my addr 172.21.15.149:0/68186355 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d56000640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d60155880 0x7f9d6013c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5f400640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d60155c50 0x7f9d60150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 -- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d60155c50 msgr2=0x7f9d60150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d60155c50 0x7f9d60150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 -- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d60155880 msgr2=0x7f9d6013c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d60155880 0x7f9d6013c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.506+0000 7f9d5ea00640 1 -- 172.21.15.149:0/68186355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5000b700 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.507+0000 7f9d5ea00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 0x7f9d6015a770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b4a0 tx=0x7f9d5003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.507+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5003bba0 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.507+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5003bd20 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.507+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50043640 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.507+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6015ed20 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.507+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d600ac710 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.508+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d60071050 con 0x7f9d600aeb70 2024-08-17T02:47:29.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.509+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d5002f070 con 0x7f9d600aeb70 2024-08-17T02:47:29.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.510+0000 7f9d56a00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.510+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5469+0+0 (secure 0 0 0) 0x7f9d500a2ef0 con 0x7f9d600aeb70 2024-08-17T02:47:29.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.510+0000 7f9d56000640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.510+0000 7f9d56000640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d6015d800 tx=0x7f9d480090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.514+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9d500710b0 con 0x7f9d600aeb70 2024-08-17T02:47:29.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:29.689+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9d600cc150 con 0x7f9d600aeb70 2024-08-17T02:47:30.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.329+0000 7f9d56a00640 1 -- 172.21.15.149:0/68186355 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9d500746d0 con 0x7f9d600aeb70 2024-08-17T02:47:30.330 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2024-08-17T02:47:30.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 msgr2=0x7f9d3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d6015d800 tx=0x7f9d480090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 msgr2=0x7f9d6015a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 0x7f9d6015a770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b4a0 tx=0x7f9d5003a000 comp rx=0 tx=0).stop 2024-08-17T02:47:30.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 shutdown_connections 2024-08-17T02:47:30.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9d3c065150 0x7f9d3c067600 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d6015d800 tx=0x7f9d480090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d60155c50 0x7f9d60150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d60155880 0x7f9d6013c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 --2- 172.21.15.149:0/68186355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d600aeb70 0x7f9d6015a770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.332+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 >> 172.21.15.149:0/68186355 conn(0x7f9d60067750 msgr2=0x7f9d60158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.333+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 shutdown_connections 2024-08-17T02:47:30.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.333+0000 7f9d5fe00640 1 -- 172.21.15.149:0/68186355 wait complete. 2024-08-17T02:47:30.350 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:47:30.350 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:47:30.350 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:47:30.350 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:30.350 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:47:30.351 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:47:30.351 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:47:30.351 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:30.351 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:47:30.351 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:47:30.351 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:47:30.351 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:30.351 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:47:30.352 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:47:30.352 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:47:30.352 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:30.366 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:47:30.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:47:30.367 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:47:30.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:47:30.374 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:47:30.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:47:30.375 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:47:30.375 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:47:30.411 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:47:30.411 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:30.413 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:47:30.414 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:30.418 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:47:30.419 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:30.421 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:47:30.421 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:30.421 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:47:30.535 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2024-08-17T02:47:30.536 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2024-08-17T02:47:30.551 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2024-08-17T02:47:30.551 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2024-08-17T02:47:30.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.580+0000 7f40a5a00640 1 Processor -- start 2024-08-17T02:47:30.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.580+0000 7f40a5a00640 1 -- start start 2024-08-17T02:47:30.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f40a5a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40a0158d60 0x7f40a00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f40a5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a00c7420 0x7f40a00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f40a5a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a00b18d0 con 0x7f40a015cb30 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f40a5a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a00b0d00 con 0x7f40a0158d60 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f40a5a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00b0fa0 con 0x7f40a00c7420 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f409ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40a0158d60 0x7f40a00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.581+0000 7f4096000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f40a015cb30 0x7f40a00c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50790/0 (socket says 172.21.15.149:50790) 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f4096000640 1 -- 172.21.15.149:0/3229829000 learned_addr learned my addr 172.21.15.149:0/3229829000 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409f400640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a00c7420 0x7f40a00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409ea00640 1 -- 172.21.15.149:0/3229829000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a00c7420 msgr2=0x7f40a00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409ea00640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a00c7420 0x7f40a00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409ea00640 1 -- 172.21.15.149:0/3229829000 >> v1:172.21.15.149:6789/0 conn(0x7f40a015cb30 legacy=0x7f40a00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409ea00640 1 -- 172.21.15.149:0/3229829000 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00b1280 con 0x7f40a0158d60 2024-08-17T02:47:30.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409e000640 1 -- 172.21.15.149:0/3229829000 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109029809 0 0) 0x7f40a00b18d0 con 0x7f40a015cb30 2024-08-17T02:47:30.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.582+0000 7f409f400640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a00c7420 0x7f40a00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.583+0000 7f409ea00640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0158d60 0x7f40a00b1d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4090009880 tx=0x7f40900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41fc516330cf67e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.583+0000 7f409e000640 1 -- 172.21.15.149:0/3229829000 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409002ad90 con 0x7f40a0158d60 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.583+0000 7f409e000640 1 -- 172.21.15.149:0/3229829000 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090032440 con 0x7f40a0158d60 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.583+0000 7f409e000640 1 -- 172.21.15.149:0/3229829000 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900327e0 con 0x7f40a0158d60 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 -- 172.21.15.149:0/3229829000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0158d60 msgr2=0x7f40a00b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0158d60 0x7f40a00b1d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4090009880 tx=0x7f40900090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 -- 172.21.15.149:0/3229829000 shutdown_connections 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a00c7420 0x7f40a00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 --2- 172.21.15.149:0/3229829000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0158d60 0x7f40a00b1d60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 -- 172.21.15.149:0/3229829000 >> 172.21.15.149:0/3229829000 conn(0x7f40a00b3040 msgr2=0x7f40a00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 -- 172.21.15.149:0/3229829000 shutdown_connections 2024-08-17T02:47:30.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.584+0000 7f40a5a00640 1 -- 172.21.15.149:0/3229829000 wait complete. 2024-08-17T02:47:30.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.585+0000 7f40a5a00640 1 Processor -- start 2024-08-17T02:47:30.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.585+0000 7f40a5a00640 1 -- start start 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.586+0000 7f40a5a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40a00c7420 0x7f40a0098390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.586+0000 7f40a5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a0158d60 0x7f40a0150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.586+0000 7f40a5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 0x7f40a015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.586+0000 7f40a5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00988d0 con 0x7f40a015cb30 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.586+0000 7f40a5a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0098f70 con 0x7f40a00c7420 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.586+0000 7f40a5a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0099250 con 0x7f40a0158d60 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 0x7f40a015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 0x7f40a015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55258/0 (socket says 172.21.15.149:55258) 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 -- 172.21.15.149:0/1960751374 learned_addr learned my addr 172.21.15.149:0/1960751374 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409ea00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40a00c7420 0x7f40a0098390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f4096000640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a0158d60 0x7f40a0150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 -- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a0158d60 msgr2=0x7f40a0150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a0158d60 0x7f40a0150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 -- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40a00c7420 msgr2=0x7f40a0098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40a00c7420 0x7f40a0098390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 -- 172.21.15.149:0/1960751374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090009390 con 0x7f40a015cb30 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409ea00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40a00c7420 0x7f40a0098390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f409f400640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 0x7f40a015cfc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f409800d150 tx=0x7f4098009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.587+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098015440 con 0x7f40a015cb30 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.588+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800f040 con 0x7f40a015cb30 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.588+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098015810 con 0x7f40a015cb30 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.588+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a0099530 con 0x7f40a015cb30 2024-08-17T02:47:30.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.588+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a0099af0 con 0x7f40a015cb30 2024-08-17T02:47:30.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.589+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0068fb0 con 0x7f40a015cb30 2024-08-17T02:47:30.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.589+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f409801e3b0 con 0x7f40a015cb30 2024-08-17T02:47:30.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.590+0000 7f4096a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f407c065150 0x7f407c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.590+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4098082b40 con 0x7f40a015cb30 2024-08-17T02:47:30.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.591+0000 7f409ea00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f407c065150 0x7f407c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.591+0000 7f409ea00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f407c065150 0x7f407c067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4090034000 tx=0x7f4090032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.594+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40a0068fb0 con 0x7f40a015cb30 2024-08-17T02:47:30.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:30.780+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f40a0068fb0 con 0x7f40a015cb30 2024-08-17T02:47:31.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.342+0000 7f4096a00640 1 -- 172.21.15.149:0/1960751374 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f40a0068fb0 con 0x7f40a015cb30 2024-08-17T02:47:31.343 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f407c065150 msgr2=0x7f407c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f407c065150 0x7f407c067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4090034000 tx=0x7f4090032000 comp rx=0 tx=0).stop 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 msgr2=0x7f40a015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 0x7f40a015cfc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f409800d150 tx=0x7f4098009a50 comp rx=0 tx=0).stop 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 shutdown_connections 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f407c065150 0x7f407c067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a015cb30 0x7f40a015cfc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40a0158d60 0x7f40a0150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 --2- 172.21.15.149:0/1960751374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40a00c7420 0x7f40a0098390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 >> 172.21.15.149:0/1960751374 conn(0x7f40a00b3040 msgr2=0x7f40a0153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 shutdown_connections 2024-08-17T02:47:31.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.345+0000 7f40a5a00640 1 -- 172.21.15.149:0/1960751374 wait complete. 2024-08-17T02:47:31.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:47:31.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.512+0000 7fed0b200640 1 Processor -- start 2024-08-17T02:47:31.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.512+0000 7fed0b200640 1 -- start start 2024-08-17T02:47:31.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed0b200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed04155a20 0x7fed040adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed0b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed04156670 con 0x7fed0406df00 2024-08-17T02:47:31.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed0b200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0406e5e0 con 0x7fed04155df0 2024-08-17T02:47:31.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed0b200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed040b0350 con 0x7fed04155a20 2024-08-17T02:47:31.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed09200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fed0406df00 0x7fed04156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50794/0 (socket says 172.21.15.149:50794) 2024-08-17T02:47:31.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed09200640 1 -- 172.21.15.149:0/2273367518 learned_addr learned my addr 172.21.15.149:0/2273367518 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:31.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed03e00640 1 --2- 172.21.15.149:0/2273367518 >> v2:172.21.15.149:3300/0 conn(0x7fed04155a20 0x7fed040adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed03400640 1 -- 172.21.15.149:0/2273367518 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007109278 0 0) 0x7fed04156670 con 0x7fed0406df00 2024-08-17T02:47:31.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.514+0000 7fed03400640 1 -- 172.21.15.149:0/2273367518 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece80034e0 con 0x7fed0406df00 2024-08-17T02:47:31.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.515+0000 7fed03e00640 1 -- 172.21.15.149:0/2273367518 >> v1:172.21.15.161:6789/0 conn(0x7fed04155df0 legacy=0x7fed0406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.515+0000 7fed03e00640 1 -- 172.21.15.149:0/2273367518 >> v1:172.21.15.149:6789/0 conn(0x7fed0406df00 legacy=0x7fed04156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.515+0000 7fed03e00640 1 -- 172.21.15.149:0/2273367518 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0406e8c0 con 0x7fed04155a20 2024-08-17T02:47:31.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed03e00640 1 --2- 172.21.15.149:0/2273367518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed040adf10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009850 tx=0x7fecf40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b511681dbf523998 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed03400640 1 -- 172.21.15.149:0/2273367518 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf402adb0 con 0x7fed04155a20 2024-08-17T02:47:31.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed03400640 1 -- 172.21.15.149:0/2273367518 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf4032440 con 0x7fed04155a20 2024-08-17T02:47:31.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed03400640 1 -- 172.21.15.149:0/2273367518 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40327c0 con 0x7fed04155a20 2024-08-17T02:47:31.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed0b200640 1 -- 172.21.15.149:0/2273367518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 msgr2=0x7fed040adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed0b200640 1 --2- 172.21.15.149:0/2273367518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed040adf10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009850 tx=0x7fecf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed0b200640 1 -- 172.21.15.149:0/2273367518 shutdown_connections 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed0b200640 1 --2- 172.21.15.149:0/2273367518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed040adf10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.516+0000 7fed0b200640 1 -- 172.21.15.149:0/2273367518 >> 172.21.15.149:0/2273367518 conn(0x7fed040cb9b0 msgr2=0x7fed040cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.517+0000 7fed0b200640 1 -- 172.21.15.149:0/2273367518 shutdown_connections 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.517+0000 7fed0b200640 1 -- 172.21.15.149:0/2273367518 wait complete. 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.518+0000 7fed0b200640 1 Processor -- start 2024-08-17T02:47:31.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.518+0000 7fed0b200640 1 -- start start 2024-08-17T02:47:31.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed0b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0406df00 0x7fed040aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed0b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed0414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed0b200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed04155df0 0x7fed040acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed0b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cb6c0 con 0x7fed04155a20 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed0b200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c1050 con 0x7fed04155df0 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed0b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c0a40 con 0x7fed0406df00 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fecfb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed0414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fecfb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed0414f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55274/0 (socket says 172.21.15.149:55274) 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fecfb400640 1 -- 172.21.15.149:0/3472214227 learned_addr learned my addr 172.21.15.149:0/3472214227 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed03e00640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0406df00 0x7fed040aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.519+0000 7fed09200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed04155df0 0x7fed040acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfb400640 1 -- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0406df00 msgr2=0x7fed040aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfb400640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0406df00 0x7fed040aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfb400640 1 -- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed04155df0 msgr2=0x7fed040acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfb400640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed04155df0 0x7fed040acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfb400640 1 -- 172.21.15.149:0/3472214227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4009390 con 0x7fed04155a20 2024-08-17T02:47:31.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfb400640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed0414f6e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c490 tx=0x7fecec007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec011590 con 0x7fed04155a20 2024-08-17T02:47:31.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec011710 con 0x7fed04155a20 2024-08-17T02:47:31.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed04169af0 con 0x7fed04155a20 2024-08-17T02:47:31.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec011ad0 con 0x7fed04155a20 2024-08-17T02:47:31.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.520+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed04169dd0 con 0x7fed04155a20 2024-08-17T02:47:31.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.522+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed04064db0 con 0x7fed04155a20 2024-08-17T02:47:31.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.522+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fecec01b3b0 con 0x7fed04155a20 2024-08-17T02:47:31.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.523+0000 7fecfbe00640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fece0065150 0x7fece0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.523+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fecec081460 con 0x7fed04155a20 2024-08-17T02:47:31.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.523+0000 7fed03e00640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fece0065150 0x7fece0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.524+0000 7fed03e00640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fece0065150 0x7fece0067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fecf4034000 tx=0x7fecf4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.527+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fecec04f920 con 0x7fed04155a20 2024-08-17T02:47:31.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.764+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fed0406d7a0 con 0x7fed04155a20 2024-08-17T02:47:31.766 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.764+0000 7fecfbe00640 1 -- 172.21.15.149:0/3472214227 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fecec017020 con 0x7fed04155a20 2024-08-17T02:47:31.766 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDWDsBmFdxlKBAApqflEVQTC/nKsGPvvXCs8A==", 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.767 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDWDsBm1tloOxAAVCWYrCZwPqjbJzet+Z5ocg==", 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.768 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDWDsBmCmTsMRAAgAn6rawlRiQ7eVv56ZMJrg==", 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDXDsBmmZlQCRAAZREbau1SyFint5EmD1uiaA==", 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDaDsBmgCSnGxAAyc0cTRYrSZwDsVMlNE6FTA==", 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2024-08-17T02:47:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDdDsBmsfXeHxAAYQTtqh0cYFa43CvxnQQoLA==", 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDgDsBmB3jaIhAAZPy5LHl68XAJZ+hMhibiKA==", 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.772 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDjDsBmcs/jJhAATXHgCplk4U3GukUEzapRGw==", 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDpDsBmzYvmIBAAPDG91iHyBW/sPTDXSEpkKQ==", 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDsDsBmnhE7JxAAUklJBo+4OIQyas3XgJX2iA==", 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDvDsBmwlJgLBAABnoztGVyL3UsemP0nhWRAg==", 2024-08-17T02:47:31.775 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDyDsBmcFRVMBAAkQfBeUkGdxGMa26X7X2Bmg==", 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDXDsBme3p7ERAAtoOUldOEC3K9EbCl25U7eQ==", 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2024-08-17T02:47:31.777 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDXDsBmjMa0HRAAN+YMKYfNt6XY7GwUZwObpg==", 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDXDsBmHmOUFxAA/+lS+DPTrCQSKwcr4DNMzg==", 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDXDsBmzMbXIxAA+wKTTB8KRorOuuZVcoLbxA==", 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.780 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDVDsBmv/pXNRAAEk15sCbl1CI69VfewOSB9A==", 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:47:31.781 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD/DsBmd2naCRAAWMffMahckuDGZStZxWdxEA==", 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD/DsBm6HPaCRAAEh1MN4JfmUrg+95CDpSWBw==", 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD/DsBmeHzaCRAAfQuyQf8fShgHRNa3cyk7LA==", 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD/DsBmp4faCRAAD3ouk8Z5M3Q8coE/4OOLBg==", 2024-08-17T02:47:31.783 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD/DsBmJ5DaCRAAUiVAcjZmq4B1w60Z7UsNgA==", 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD/DsBmQZnaCRAAD/fiAxpj7kvFMrdIlNTcZQ==", 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDWDsBmdZ8XIhAAWrDpu414FjXJ6jEJAU+gBw==", 2024-08-17T02:47:31.785 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDWDsBmxDNeGxAANJWLu81anA4poe6/LnXAwA==", 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2024-08-17T02:47:31.786 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2024-08-17T02:47:31.787 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2024-08-17T02:47:31.787 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2024-08-17T02:47:31.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:31.787 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-08-17T02:47:31.787 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.766+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fece0065150 msgr2=0x7fece0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fece0065150 0x7fece0067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fecf4034000 tx=0x7fecf4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 msgr2=0x7fed0414f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed0414f6e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c490 tx=0x7fecec007e70 comp rx=0 tx=0).stop 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 shutdown_connections 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fece0065150 0x7fece0067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed04155df0 0x7fed040acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed04155a20 0x7fed0414f6e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 --2- 172.21.15.149:0/3472214227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0406df00 0x7fed040aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 >> 172.21.15.149:0/3472214227 conn(0x7fed040cb9b0 msgr2=0x7fed04158510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 shutdown_connections 2024-08-17T02:47:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.767+0000 7fed0b200640 1 -- 172.21.15.149:0/3472214227 wait complete. 2024-08-17T02:47:31.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:47:31.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.938+0000 7f2dbec00640 1 Processor -- start 2024-08-17T02:47:31.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.939+0000 7f2dbec00640 1 -- start start 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbec00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2db8068510 0x7f2db806de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbec00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2db8069170 0x7f2db80695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbec00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db8069b00 con 0x7f2db815c8d0 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbec00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80688e0 con 0x7f2db8068510 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbec00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db815d8a0 con 0x7f2db8069170 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbd800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2db8068510 0x7f2db806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbe200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2db815c8d0 0x7f2db815ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50806/0 (socket says 172.21.15.149:50806) 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbe200640 1 -- 172.21.15.149:0/1748204873 learned_addr learned my addr 172.21.15.149:0/1748204873 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:31.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.940+0000 7f2dbce00640 1 --2- 172.21.15.149:0/1748204873 >> v2:172.21.15.161:3300/0 conn(0x7f2db8069170 0x7f2db80695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.941+0000 7f2dbd800640 1 -- 172.21.15.149:0/1748204873 >> v2:172.21.15.161:3300/0 conn(0x7f2db8069170 msgr2=0x7f2db80695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:31.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.941+0000 7f2dbd800640 1 --2- 172.21.15.149:0/1748204873 >> v2:172.21.15.161:3300/0 conn(0x7f2db8069170 0x7f2db80695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.941+0000 7f2dbd800640 1 -- 172.21.15.149:0/1748204873 >> v1:172.21.15.149:6789/0 conn(0x7f2db815c8d0 legacy=0x7f2db815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.941+0000 7f2dbd800640 1 -- 172.21.15.149:0/1748204873 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db806d0b0 con 0x7f2db8068510 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.941+0000 7f2db7e00640 1 -- 172.21.15.149:0/1748204873 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920539741 0 0) 0x7f2db8069b00 con 0x7f2db815c8d0 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.942+0000 7f2dbd800640 1 --2- 172.21.15.149:0/1748204873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db8068510 0x7f2db806de30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2db8076e00 tx=0x7f2dac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8cb9ec57d538a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.942+0000 7f2db7e00640 1 -- 172.21.15.149:0/1748204873 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac02ad90 con 0x7f2db8068510 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.942+0000 7f2db7e00640 1 -- 172.21.15.149:0/1748204873 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac032440 con 0x7f2db8068510 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.942+0000 7f2db7e00640 1 -- 172.21.15.149:0/1748204873 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0327e0 con 0x7f2db8068510 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.942+0000 7f2dbec00640 1 -- 172.21.15.149:0/1748204873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db8068510 msgr2=0x7f2db806de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.942+0000 7f2dbec00640 1 --2- 172.21.15.149:0/1748204873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db8068510 0x7f2db806de30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2db8076e00 tx=0x7f2dac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.943+0000 7f2dbec00640 1 -- 172.21.15.149:0/1748204873 shutdown_connections 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.943+0000 7f2dbec00640 1 --2- 172.21.15.149:0/1748204873 >> v2:172.21.15.161:3300/0 conn(0x7f2db8069170 0x7f2db80695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.943+0000 7f2dbec00640 1 --2- 172.21.15.149:0/1748204873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db8068510 0x7f2db806de30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.943+0000 7f2dbec00640 1 -- 172.21.15.149:0/1748204873 >> 172.21.15.149:0/1748204873 conn(0x7f2db80cc040 msgr2=0x7f2db80cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.943+0000 7f2dbec00640 1 -- 172.21.15.149:0/1748204873 shutdown_connections 2024-08-17T02:47:31.946 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.943+0000 7f2dbec00640 1 -- 172.21.15.149:0/1748204873 wait complete. 2024-08-17T02:47:31.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.944+0000 7f2dbec00640 1 Processor -- start 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.944+0000 7f2dbec00640 1 -- start start 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbec00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 0x7f2db8145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbec00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2db8069170 0x7f2db80c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 0x7f2db8158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80ace20 con 0x7f2db815c8d0 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbec00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8145bb0 con 0x7f2db8068510 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbec00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80ac210 con 0x7f2db8069170 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbe200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 0x7f2db8158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbd800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 0x7f2db8145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbce00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2db8069170 0x7f2db80c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbe200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 0x7f2db8158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55288/0 (socket says 172.21.15.149:55288) 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbd800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 0x7f2db8145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:56038/0 (socket says 172.21.15.149:56038) 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbce00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2db8069170 0x7f2db80c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:45310/0 (socket says 172.21.15.149:45310) 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.945+0000 7f2dbe200640 1 -- 172.21.15.149:0/4277813871 learned_addr learned my addr 172.21.15.149:0/4277813871 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbe200640 1 -- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2db8069170 msgr2=0x7f2db80c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbe200640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2db8069170 0x7f2db80c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbe200640 1 -- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 msgr2=0x7f2db8145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbe200640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 0x7f2db8145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbe200640 1 -- 172.21.15.149:0/4277813871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac009390 con 0x7f2db815c8d0 2024-08-17T02:47:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbd800640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 0x7f2db8145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2dbe200640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 0x7f2db8158830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2db000cbf0 tx=0x7f2db00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.946+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ce10 con 0x7f2db815c8d0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.947+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000a850 con 0x7f2db815c8d0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.947+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ac90 con 0x7f2db815c8d0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.947+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db80ac4f0 con 0x7f2db815c8d0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.947+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db80acab0 con 0x7f2db815c8d0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.948+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db80acfd0 con 0x7f2db815c8d0 2024-08-17T02:47:31.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.949+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2db0007300 con 0x7f2db815c8d0 2024-08-17T02:47:31.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.949+0000 7f2db4c00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d98065150 0x7f2d98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.949+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2db0082100 con 0x7f2db815c8d0 2024-08-17T02:47:31.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.950+0000 7f2dbd800640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d98065150 0x7f2d98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.950+0000 7f2dbd800640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d98065150 0x7f2d98067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2dac034000 tx=0x7f2dac032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:31.954+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2db80acfd0 con 0x7f2db815c8d0 2024-08-17T02:47:32.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.188+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2db8071050 con 0x7f2db815c8d0 2024-08-17T02:47:32.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.191+0000 7f2db4c00640 1 -- 172.21.15.149:0/4277813871 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2db00505a0 con 0x7f2db815c8d0 2024-08-17T02:47:32.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d98065150 msgr2=0x7f2d98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d98065150 0x7f2d98067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2dac034000 tx=0x7f2dac032000 comp rx=0 tx=0).stop 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 msgr2=0x7f2db8158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 0x7f2db8158830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2db000cbf0 tx=0x7f2db00019b0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 shutdown_connections 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d98065150 0x7f2d98067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db815c8d0 0x7f2db8158830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2db8069170 0x7f2db80c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 --2- 172.21.15.149:0/4277813871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8068510 0x7f2db8145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 >> 172.21.15.149:0/4277813871 conn(0x7f2db80cc040 msgr2=0x7f2db806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 shutdown_connections 2024-08-17T02:47:32.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.194+0000 7f2dbec00640 1 -- 172.21.15.149:0/4277813871 wait complete. 2024-08-17T02:47:32.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:47:32.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.363+0000 7f1e16e00640 1 Processor -- start 2024-08-17T02:47:32.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.363+0000 7f1e16e00640 1 -- start start 2024-08-17T02:47:32.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e16e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e1006df00 0x7f1e100adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e16e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e10155df0 0x7f1e100ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e16e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e10156670 con 0x7f1e10155a20 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e16e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e100b0350 con 0x7f1e1006df00 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e16e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1006e5e0 con 0x7f1e10155df0 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e1006df00 0x7f1e100adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e1006df00 0x7f1e100adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55292/0 (socket says 172.21.15.149:55292) 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 -- 172.21.15.149:0/360170446 learned_addr learned my addr 172.21.15.149:0/360170446 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:32.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e14e00640 1 --2- 172.21.15.149:0/360170446 >> v2:172.21.15.161:3300/0 conn(0x7f1e10155df0 0x7f1e100ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e0f400640 1 -- 172.21.15.149:0/360170446 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894655390 0 0) 0x7f1e10156670 con 0x7f1e10155a20 2024-08-17T02:47:32.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e0f400640 1 -- 172.21.15.149:0/360170446 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df40034e0 con 0x7f1e10155a20 2024-08-17T02:47:32.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 -- 172.21.15.149:0/360170446 >> v2:172.21.15.161:3300/0 conn(0x7f1e10155df0 msgr2=0x7f1e100ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:32.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 --2- 172.21.15.149:0/360170446 >> v2:172.21.15.161:3300/0 conn(0x7f1e10155df0 0x7f1e100ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 -- 172.21.15.149:0/360170446 >> v1:172.21.15.161:6789/0 conn(0x7f1e10155a20 legacy=0x7f1e1006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e07400640 1 -- 172.21.15.149:0/360170446 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1006e8c0 con 0x7f1e1006df00 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.365+0000 7f1e14e00640 1 --2- 172.21.15.149:0/360170446 >> v2:172.21.15.161:3300/0 conn(0x7f1e10155df0 0x7f1e100ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.366+0000 7f1e07400640 1 --2- 172.21.15.149:0/360170446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1006df00 0x7f1e100adf10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b0710 tx=0x7f1df80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7056423ea007f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e0f400640 1 -- 172.21.15.149:0/360170446 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df802add0 con 0x7f1e1006df00 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e0f400640 1 -- 172.21.15.149:0/360170446 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8032440 con 0x7f1e1006df00 2024-08-17T02:47:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e0f400640 1 -- 172.21.15.149:0/360170446 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8032820 con 0x7f1e1006df00 2024-08-17T02:47:32.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 -- 172.21.15.149:0/360170446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1006df00 msgr2=0x7f1e100adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 --2- 172.21.15.149:0/360170446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1006df00 0x7f1e100adf10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b0710 tx=0x7f1df80091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 -- 172.21.15.149:0/360170446 shutdown_connections 2024-08-17T02:47:32.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 --2- 172.21.15.149:0/360170446 >> v2:172.21.15.161:3300/0 conn(0x7f1e10155df0 0x7f1e100ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 --2- 172.21.15.149:0/360170446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1006df00 0x7f1e100adf10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 -- 172.21.15.149:0/360170446 >> 172.21.15.149:0/360170446 conn(0x7f1e100cb9b0 msgr2=0x7f1e100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 -- 172.21.15.149:0/360170446 shutdown_connections 2024-08-17T02:47:32.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.367+0000 7f1e16e00640 1 -- 172.21.15.149:0/360170446 wait complete. 2024-08-17T02:47:32.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.369+0000 7f1e16e00640 1 Processor -- start 2024-08-17T02:47:32.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.369+0000 7f1e16e00640 1 -- start start 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e16e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1006df00 0x7f1e1014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e16e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e10155a20 0x7f1e10069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e16e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 0x7f1e10152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e16e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10069c30 con 0x7f1e10155df0 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e16e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10168fa0 con 0x7f1e10155a20 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e16e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10068c20 con 0x7f1e1006df00 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e14e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 0x7f1e10152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e14e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 0x7f1e10152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55300/0 (socket says 172.21.15.149:55300) 2024-08-17T02:47:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e14e00640 1 -- 172.21.15.149:0/2971576577 learned_addr learned my addr 172.21.15.149:0/2971576577 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e07400640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e10155a20 0x7f1e10069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.370+0000 7f1e0fe00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1006df00 0x7f1e1014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e14e00640 1 -- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1006df00 msgr2=0x7f1e1014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e14e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1006df00 0x7f1e1014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e14e00640 1 -- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e10155a20 msgr2=0x7f1e10069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e14e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e10155a20 0x7f1e10069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e14e00640 1 -- 172.21.15.149:0/2971576577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08009a20 con 0x7f1e10155df0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e14e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 0x7f1e10152e30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009f50 tx=0x7f1e0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800cd90 con 0x7f1e10155df0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800f040 con 0x7f1e10155df0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df8009450 con 0x7f1e10155df0 2024-08-17T02:47:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080146b0 con 0x7f1e10155df0 2024-08-17T02:47:32.375 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.371+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100691e0 con 0x7f1e10155df0 2024-08-17T02:47:32.375 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.372+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e101691c0 con 0x7f1e10155df0 2024-08-17T02:47:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.373+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e08014aa0 con 0x7f1e10155df0 2024-08-17T02:47:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.374+0000 7f1e07e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1dec065150 0x7f1dec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.374+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1e08082f00 con 0x7f1e10155df0 2024-08-17T02:47:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.374+0000 7f1e0fe00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1dec065150 0x7f1dec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.375+0000 7f1e0fe00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1dec065150 0x7f1dec067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e00003a10 tx=0x7f1e00007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.379 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.378+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e101691c0 con 0x7f1e10155df0 2024-08-17T02:47:32.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.615+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f1e10169160 con 0x7f1e10155df0 2024-08-17T02:47:32.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.619+0000 7f1e07e00640 1 -- 172.21.15.149:0/2971576577 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1e080180a0 con 0x7f1e10155df0 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1dec065150 msgr2=0x7f1dec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1dec065150 0x7f1dec067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e00003a10 tx=0x7f1e00007cc0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 msgr2=0x7f1e10152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 0x7f1e10152e30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009f50 tx=0x7f1e0800b040 comp rx=0 tx=0).stop 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 shutdown_connections 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1dec065150 0x7f1dec067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e10155df0 0x7f1e10152e30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e10155a20 0x7f1e10069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 --2- 172.21.15.149:0/2971576577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1006df00 0x7f1e1014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 >> 172.21.15.149:0/2971576577 conn(0x7f1e100cb9b0 msgr2=0x7f1e101523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 shutdown_connections 2024-08-17T02:47:32.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.621+0000 7f1e16e00640 1 -- 172.21.15.149:0/2971576577 wait complete. 2024-08-17T02:47:32.638 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:47:32.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.787+0000 7f2f88c00640 1 Processor -- start 2024-08-17T02:47:32.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.788+0000 7f2f88c00640 1 -- start start 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f88c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f84155900 0x7f2f84155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f88c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f840b0270 0x7f2f84156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f88c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f84157690 con 0x7f2f84157b20 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f88c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f84156a80 con 0x7f2f840b0270 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f88c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f84156d60 con 0x7f2f84155900 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f7aa00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f840b0270 0x7f2f84156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f7aa00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f840b0270 0x7f2f84156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55308/0 (socket says 172.21.15.149:55308) 2024-08-17T02:47:32.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f7aa00640 1 -- 172.21.15.149:0/1489489197 learned_addr learned my addr 172.21.15.149:0/1489489197 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:32.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.789+0000 7f2f83400640 1 --2- 172.21.15.149:0/1489489197 >> v2:172.21.15.161:3300/0 conn(0x7f2f84155900 0x7f2f84155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.790+0000 7f2f7aa00640 1 -- 172.21.15.149:0/1489489197 >> v2:172.21.15.161:3300/0 conn(0x7f2f84155900 msgr2=0x7f2f84155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:32.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.790+0000 7f2f7aa00640 1 --2- 172.21.15.149:0/1489489197 >> v2:172.21.15.161:3300/0 conn(0x7f2f84155900 0x7f2f84155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.790+0000 7f2f7aa00640 1 -- 172.21.15.149:0/1489489197 >> v1:172.21.15.161:6789/0 conn(0x7f2f84157b20 legacy=0x7f2f84157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.790+0000 7f2f7aa00640 1 -- 172.21.15.149:0/1489489197 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84157040 con 0x7f2f840b0270 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.791+0000 7f2f7aa00640 1 --2- 172.21.15.149:0/1489489197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f84156210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f84065fd0 tx=0x7f2f6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47ee8b29dc5616e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.791+0000 7f2f82a00640 1 -- 172.21.15.149:0/1489489197 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c02adf0 con 0x7f2f840b0270 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.791+0000 7f2f82a00640 1 -- 172.21.15.149:0/1489489197 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c032440 con 0x7f2f840b0270 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.791+0000 7f2f82a00640 1 -- 172.21.15.149:0/1489489197 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032820 con 0x7f2f840b0270 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.791+0000 7f2f88c00640 1 -- 172.21.15.149:0/1489489197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 msgr2=0x7f2f84156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.791+0000 7f2f88c00640 1 --2- 172.21.15.149:0/1489489197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f84156210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f84065fd0 tx=0x7f2f6c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.792+0000 7f2f88c00640 1 -- 172.21.15.149:0/1489489197 shutdown_connections 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.792+0000 7f2f88c00640 1 --2- 172.21.15.149:0/1489489197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f84156210 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.792+0000 7f2f88c00640 1 --2- 172.21.15.149:0/1489489197 >> v2:172.21.15.161:3300/0 conn(0x7f2f84155900 0x7f2f84155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.792+0000 7f2f88c00640 1 -- 172.21.15.149:0/1489489197 >> 172.21.15.149:0/1489489197 conn(0x7f2f84067750 msgr2=0x7f2f840cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.792+0000 7f2f88c00640 1 -- 172.21.15.149:0/1489489197 shutdown_connections 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.792+0000 7f2f88c00640 1 -- 172.21.15.149:0/1489489197 wait complete. 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.793+0000 7f2f88c00640 1 Processor -- start 2024-08-17T02:47:32.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.793+0000 7f2f88c00640 1 -- start start 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f88c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f8416d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f88c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f84155900 0x7f2f840a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f88c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84157b20 0x7f2f840ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f88c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840a54d0 con 0x7f2f840b0270 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f88c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840a6050 con 0x7f2f84157b20 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f88c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840ca6b0 con 0x7f2f84155900 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f83400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f8416d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f83400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f8416d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55316/0 (socket says 172.21.15.149:55316) 2024-08-17T02:47:32.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.794+0000 7f2f83400640 1 -- 172.21.15.149:0/3875689195 learned_addr learned my addr 172.21.15.149:0/3875689195 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f7aa00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f84155900 0x7f2f840a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83e00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84157b20 0x7f2f840ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83400640 1 -- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f84155900 msgr2=0x7f2f840a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83400640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f84155900 0x7f2f840a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83400640 1 -- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84157b20 msgr2=0x7f2f840ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83400640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84157b20 0x7f2f840ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83400640 1 -- 172.21.15.149:0/3875689195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009450 con 0x7f2f840b0270 2024-08-17T02:47:32.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f7aa00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f84155900 0x7f2f840a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83e00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84157b20 0x7f2f840ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f83400640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f8416d010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400ea50 tx=0x7f2f740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400ca10 con 0x7f2f840b0270 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400cb70 con 0x7f2f840b0270 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74013470 con 0x7f2f840b0270 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f840a5720 con 0x7f2f840b0270 2024-08-17T02:47:32.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.795+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f840a5ce0 con 0x7f2f840b0270 2024-08-17T02:47:32.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.796+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f84065050 con 0x7f2f840b0270 2024-08-17T02:47:32.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.797+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2f74013860 con 0x7f2f840b0270 2024-08-17T02:47:32.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.798+0000 7f2f7b400640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f60065150 0x7f2f60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.798+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f740824e0 con 0x7f2f840b0270 2024-08-17T02:47:32.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.798+0000 7f2f7aa00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f60065150 0x7f2f60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.799+0000 7f2f7aa00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f60065150 0x7f2f60067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c034000 tx=0x7f2f6c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:32.802+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2f84065050 con 0x7f2f840b0270 2024-08-17T02:47:33.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.036+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2f84065050 con 0x7f2f840b0270 2024-08-17T02:47:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.040+0000 7f2f7b400640 1 -- 172.21.15.149:0/3875689195 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2f84065050 con 0x7f2f840b0270 2024-08-17T02:47:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.042+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f60065150 msgr2=0x7f2f60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.042+0000 7f2f88c00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f60065150 0x7f2f60067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c034000 tx=0x7f2f6c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.042+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 msgr2=0x7f2f8416d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.042+0000 7f2f88c00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f8416d010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400ea50 tx=0x7f2f740090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 shutdown_connections 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f60065150 0x7f2f60067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84157b20 0x7f2f840ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f84155900 0x7f2f840a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 --2- 172.21.15.149:0/3875689195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f840b0270 0x7f2f8416d010 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 >> 172.21.15.149:0/3875689195 conn(0x7f2f84067750 msgr2=0x7f2f840ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 shutdown_connections 2024-08-17T02:47:33.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.043+0000 7f2f88c00640 1 -- 172.21.15.149:0/3875689195 wait complete. 2024-08-17T02:47:33.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:47:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.208+0000 7f3d63c00640 1 Processor -- start 2024-08-17T02:47:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.208+0000 7f3d63c00640 1 -- start start 2024-08-17T02:47:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.209+0000 7f3d63c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c0b1440 0x7f3d5c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.209+0000 7f3d63c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d5c140580 0x7f3d5c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.209+0000 7f3d63c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0caa80 con 0x7f3d5c1401b0 2024-08-17T02:47:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.209+0000 7f3d63c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0cb450 con 0x7f3d5c140580 2024-08-17T02:47:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.209+0000 7f3d63c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c9e70 con 0x7f3d5c0b1440 2024-08-17T02:47:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d5c140580 0x7f3d5c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d5c140580 0x7f3d5c0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:56084/0 (socket says 172.21.15.149:56084) 2024-08-17T02:47:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 -- 172.21.15.149:0/916456291 learned_addr learned my addr 172.21.15.149:0/916456291 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d53e00640 1 --2- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c0b1440 0x7f3d5c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61200640 1 --1- 172.21.15.149:0/916456291 >> v1:172.21.15.161:6789/0 conn(0x7f3d5c1401b0 0x7f3d5c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:38006/0 (socket says 172.21.15.149:38006) 2024-08-17T02:47:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 -- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c0b1440 msgr2=0x7f3d5c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 --2- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c0b1440 0x7f3d5c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 -- 172.21.15.149:0/916456291 >> v1:172.21.15.161:6789/0 conn(0x7f3d5c1401b0 legacy=0x7f3d5c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.210+0000 7f3d61c00640 1 -- 172.21.15.149:0/916456291 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0ca150 con 0x7f3d5c140580 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.211+0000 7f3d61c00640 1 --2- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c140580 0x7f3d5c0c9040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009f20 tx=0x7f3d54009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebbcda20c83972d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d5be00640 1 -- 172.21.15.149:0/916456291 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54031400 con 0x7f3d5c140580 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d5be00640 1 -- 172.21.15.149:0/916456291 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5402d050 con 0x7f3d5c140580 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d5be00640 1 -- 172.21.15.149:0/916456291 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540317d0 con 0x7f3d5c140580 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 -- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c140580 msgr2=0x7f3d5c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 --2- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c140580 0x7f3d5c0c9040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009f20 tx=0x7f3d54009840 comp rx=0 tx=0).stop 2024-08-17T02:47:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 -- 172.21.15.149:0/916456291 shutdown_connections 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 --2- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c140580 0x7f3d5c0c9040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 --2- 172.21.15.149:0/916456291 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c0b1440 0x7f3d5c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 -- 172.21.15.149:0/916456291 >> 172.21.15.149:0/916456291 conn(0x7f3d5c0cb9b0 msgr2=0x7f3d5c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 -- 172.21.15.149:0/916456291 shutdown_connections 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.212+0000 7f3d63c00640 1 -- 172.21.15.149:0/916456291 wait complete. 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.214+0000 7f3d63c00640 1 Processor -- start 2024-08-17T02:47:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.214+0000 7f3d63c00640 1 -- start start 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d63c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c0b1440 0x7f3d5c12aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d63c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 0x7f3d5c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d63c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c140580 0x7f3d5c0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d63c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c68d0 con 0x7f3d5c1401b0 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d63c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c5d00 con 0x7f3d5c0b1440 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d63c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c5fa0 con 0x7f3d5c140580 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 0x7f3d5c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 0x7f3d5c0ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55320/0 (socket says 172.21.15.149:55320) 2024-08-17T02:47:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 -- 172.21.15.149:0/2755468070 learned_addr learned my addr 172.21.15.149:0/2755468070 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d61200640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c0b1440 0x7f3d5c12aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d61c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c140580 0x7f3d5c0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 -- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c140580 msgr2=0x7f3d5c0c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c140580 0x7f3d5c0c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 -- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c0b1440 msgr2=0x7f3d5c12aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c0b1440 0x7f3d5c12aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.215+0000 7f3d53e00640 1 -- 172.21.15.149:0/2755468070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54009ae0 con 0x7f3d5c1401b0 2024-08-17T02:47:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.216+0000 7f3d53e00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 0x7f3d5c0ad260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e900 tx=0x7f3d440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.216+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400c970 con 0x7f3d5c1401b0 2024-08-17T02:47:33.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.216+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400cad0 con 0x7f3d5c1401b0 2024-08-17T02:47:33.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.216+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ce70 con 0x7f3d5c1401b0 2024-08-17T02:47:33.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.216+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0c6280 con 0x7f3d5c1401b0 2024-08-17T02:47:33.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.216+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c13cc00 con 0x7f3d5c1401b0 2024-08-17T02:47:33.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.217+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c0c6a40 con 0x7f3d5c1401b0 2024-08-17T02:47:33.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.218+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3d44013680 con 0x7f3d5c1401b0 2024-08-17T02:47:33.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.219+0000 7f3d58c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3d38065150 0x7f3d38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.219+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d44082350 con 0x7f3d5c1401b0 2024-08-17T02:47:33.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.219+0000 7f3d61200640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3d38065150 0x7f3d38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.220+0000 7f3d61200640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3d38065150 0x7f3d38067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c007800 tx=0x7f3d4c007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.223+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3d44050770 con 0x7f3d5c1401b0 2024-08-17T02:47:33.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.460+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3d5c13ce80 con 0x7f3d5c1401b0 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.464+0000 7f3d58c00640 1 -- 172.21.15.149:0/2755468070 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3d44053d90 con 0x7f3d5c1401b0 2024-08-17T02:47:33.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3d38065150 msgr2=0x7f3d38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3d38065150 0x7f3d38067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c007800 tx=0x7f3d4c007e20 comp rx=0 tx=0).stop 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 msgr2=0x7f3d5c0ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 0x7f3d5c0ad260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e900 tx=0x7f3d440090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 shutdown_connections 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3d38065150 0x7f3d38067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d5c140580 0x7f3d5c0c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5c1401b0 0x7f3d5c0ad260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 --2- 172.21.15.149:0/2755468070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d5c0b1440 0x7f3d5c12aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 >> 172.21.15.149:0/2755468070 conn(0x7f3d5c0cb9b0 msgr2=0x7f3d5c159210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 shutdown_connections 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.467+0000 7f3d63c00640 1 -- 172.21.15.149:0/2755468070 wait complete. 2024-08-17T02:47:33.483 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:47:33.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.632+0000 7f228f400640 1 Processor -- start 2024-08-17T02:47:33.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.632+0000 7f228f400640 1 -- start start 2024-08-17T02:47:33.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.633+0000 7f228f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 0x7f22880ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228f400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2288159350 0x7f22880ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228f400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880cb560 con 0x7f22880cf280 2024-08-17T02:47:33.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228f400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880cf7e0 con 0x7f2288159350 2024-08-17T02:47:33.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228f400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880cfac0 con 0x7f2288158f80 2024-08-17T02:47:33.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228d400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f22880cf280 0x7f22880cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50822/0 (socket says 172.21.15.149:50822) 2024-08-17T02:47:33.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228d400640 1 -- 172.21.15.149:0/580433569 learned_addr learned my addr 172.21.15.149:0/580433569 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:33.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f228ca00640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 0x7f22880ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f2287e00640 1 --2- 172.21.15.149:0/580433569 >> v2:172.21.15.161:3300/0 conn(0x7f2288159350 0x7f22880ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294439387 0 0) 0x7f22880cb560 con 0x7f22880cf280 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.634+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22700034e0 con 0x7f22880cf280 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798715975 0 0) 0x7f22700034e0 con 0x7f22880cf280 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 msgr2=0x7f22880ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 0x7f22880ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 >> v2:172.21.15.161:3300/0 conn(0x7f2288159350 msgr2=0x7f22880ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 --2- 172.21.15.149:0/580433569 >> v2:172.21.15.161:3300/0 conn(0x7f2288159350 0x7f22880ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880caf10 con 0x7f22880cf280 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f22800017f0 con 0x7f22880cf280 2024-08-17T02:47:33.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 >> v1:172.21.15.149:6789/0 conn(0x7f22880cf280 legacy=0x7f22880cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 0x7f2270003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f2270004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2270004cc0 0x7f2270005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880cf7e0 con 0x7f2270004020 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880cfac0 con 0x7f2270004cc0 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227000bad0 con 0x7f2288158f80 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287e00640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f2270004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f228ca00640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 0x7f2270003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f228d400640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2270004cc0 0x7f2270005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287e00640 1 -- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 msgr2=0x7f2270003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287e00640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2288158f80 0x7f2270003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287e00640 1 -- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2270004cc0 msgr2=0x7f2270005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287e00640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2270004cc0 0x7f2270005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.635+0000 7f2287e00640 1 -- 172.21.15.149:0/580433569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700034e0 con 0x7f2270004020 2024-08-17T02:47:33.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.636+0000 7f2287e00640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f2270004780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2274006e70 tx=0x7f22740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cfeee3e35c2a67 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274031400 con 0x7f2270004020 2024-08-17T02:47:33.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227402d050 con 0x7f2270004020 2024-08-17T02:47:33.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f2287400640 1 -- 172.21.15.149:0/580433569 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274031790 con 0x7f2270004020 2024-08-17T02:47:33.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228f400640 1 -- 172.21.15.149:0/580433569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 msgr2=0x7f2270004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228f400640 1 --2- 172.21.15.149:0/580433569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f2270004780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2274006e70 tx=0x7f22740090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228d400640 1 -- 172.21.15.149:0/580433569 reap_dead start 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228f400640 1 -- 172.21.15.149:0/580433569 shutdown_connections 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228f400640 1 -- 172.21.15.149:0/580433569 >> 172.21.15.149:0/580433569 conn(0x7f22880cfd90 msgr2=0x7f22880d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228f400640 1 -- 172.21.15.149:0/580433569 shutdown_connections 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.637+0000 7f228f400640 1 -- 172.21.15.149:0/580433569 wait complete. 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.639+0000 7f228f400640 1 Processor -- start 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.639+0000 7f228f400640 1 -- start start 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f22881692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f228815b890 0x7f22881551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22880ca0b0 0x7f22880ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881598c0 con 0x7f2270004020 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228f400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228815c0e0 con 0x7f228815b890 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228f400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228815c3c0 con 0x7f22880ca0b0 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f22881692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f22881692d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55338/0 (socket says 172.21.15.149:55338) 2024-08-17T02:47:33.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 -- 172.21.15.149:0/2494200756 learned_addr learned my addr 172.21.15.149:0/2494200756 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228d400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22880ca0b0 0x7f22880ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f2287e00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f228815b890 0x7f22881551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 -- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22880ca0b0 msgr2=0x7f22880ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22880ca0b0 0x7f22880ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 -- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f228815b890 msgr2=0x7f22881551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f228815b890 0x7f22881551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f228ca00640 1 -- 172.21.15.149:0/2494200756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228815c6a0 con 0x7f2270004020 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.640+0000 7f2287e00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f228815b890 0x7f22881551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.641+0000 7f228ca00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f22881692d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f227c011b40 tx=0x7f227c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.641+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c00fb00 con 0x7f2270004020 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.641+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c00fc60 con 0x7f2270004020 2024-08-17T02:47:33.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.641+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228815c980 con 0x7f2270004020 2024-08-17T02:47:33.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.641+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c014440 con 0x7f2270004020 2024-08-17T02:47:33.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.641+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288155710 con 0x7f2270004020 2024-08-17T02:47:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.642+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2288064db0 con 0x7f2270004020 2024-08-17T02:47:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.643+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f227c0147f0 con 0x7f2270004020 2024-08-17T02:47:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.644+0000 7f227be00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2268065180 0x7f2268067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.644+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f227c018030 con 0x7f2270004020 2024-08-17T02:47:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.644+0000 7f2287e00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2268065180 0x7f2268067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.645+0000 7f2287e00640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2268065180 0x7f2268067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2274034000 tx=0x7f2274035000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.648+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f227c050e90 con 0x7f2270004020 2024-08-17T02:47:33.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.889+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f22880c5f10 con 0x7f2270004020 2024-08-17T02:47:33.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.893+0000 7f227be00640 1 -- 172.21.15.149:0/2494200756 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f227c0220a0 con 0x7f2270004020 2024-08-17T02:47:33.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2268065180 msgr2=0x7f2268067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.897 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2268065180 0x7f2268067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2274034000 tx=0x7f2274035000 comp rx=0 tx=0).stop 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 msgr2=0x7f22881692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f22881692d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f227c011b40 tx=0x7f227c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 shutdown_connections 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2268065180 0x7f2268067630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22880ca0b0 0x7f22880ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f228815b890 0x7f22881551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 --2- 172.21.15.149:0/2494200756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2270004020 0x7f22881692d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 >> 172.21.15.149:0/2494200756 conn(0x7f22880cfd90 msgr2=0x7f22880c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 shutdown_connections 2024-08-17T02:47:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:33.896+0000 7f228f400640 1 -- 172.21.15.149:0/2494200756 wait complete. 2024-08-17T02:47:33.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:47:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.062+0000 7f8770a00640 1 Processor -- start 2024-08-17T02:47:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.063+0000 7f8770a00640 1 -- start start 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8770a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8770a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c0cc2d0 con 0x7f876c156ad0 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8770a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c0caaf0 con 0x7f876c06dc80 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8770a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0ca900 con 0x7f876c0cbea0 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f876a800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f876c156ad0 0x7f876c06d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50830/0 (socket says 172.21.15.149:50830) 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f876a800640 1 -- 172.21.15.149:0/1010570295 learned_addr learned my addr 172.21.15.149:0/1010570295 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8761e00640 1 --2- 172.21.15.149:0/1010570295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8769e00640 1 -- 172.21.15.149:0/1010570295 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572451139 0 0) 0x7f876c0cc2d0 con 0x7f876c156ad0 2024-08-17T02:47:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.064+0000 7f8769e00640 1 -- 172.21.15.149:0/1010570295 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87500034e0 con 0x7f876c156ad0 2024-08-17T02:47:34.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.065+0000 7f8769e00640 1 -- 172.21.15.149:0/1010570295 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666046567 0 0) 0x7f876c0caaf0 con 0x7f876c06dc80 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.065+0000 7f8761e00640 1 -- 172.21.15.149:0/1010570295 >> v1:172.21.15.161:6789/0 conn(0x7f876c06dc80 legacy=0x7f876c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.065+0000 7f8761e00640 1 -- 172.21.15.149:0/1010570295 >> v1:172.21.15.149:6789/0 conn(0x7f876c156ad0 legacy=0x7f876c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.065+0000 7f8761e00640 1 -- 172.21.15.149:0/1010570295 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0cad90 con 0x7f876c0cbea0 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.066+0000 7f8761e00640 1 --2- 172.21.15.149:0/1010570295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c156ea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8754009880 tx=0x7f87540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4df9061af85afa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.066+0000 7f8769e00640 1 -- 172.21.15.149:0/1010570295 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c001470 con 0x7f876c0cbea0 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.066+0000 7f8769e00640 1 -- 172.21.15.149:0/1010570295 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875402aab0 con 0x7f876c0cbea0 2024-08-17T02:47:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.066+0000 7f8769e00640 1 -- 172.21.15.149:0/1010570295 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875402ae30 con 0x7f876c0cbea0 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 -- 172.21.15.149:0/1010570295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 msgr2=0x7f876c156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 --2- 172.21.15.149:0/1010570295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c156ea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8754009880 tx=0x7f87540090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 -- 172.21.15.149:0/1010570295 shutdown_connections 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 --2- 172.21.15.149:0/1010570295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c156ea0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 -- 172.21.15.149:0/1010570295 >> 172.21.15.149:0/1010570295 conn(0x7f876c067750 msgr2=0x7f876c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 -- 172.21.15.149:0/1010570295 shutdown_connections 2024-08-17T02:47:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.067+0000 7f8770a00640 1 -- 172.21.15.149:0/1010570295 wait complete. 2024-08-17T02:47:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.068+0000 7f8770a00640 1 Processor -- start 2024-08-17T02:47:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.068+0000 7f8770a00640 1 -- start start 2024-08-17T02:47:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f8770a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 0x7f876c0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f8770a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f8770a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c156ad0 0x7f876c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f8770a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0af7f0 con 0x7f876c06dc80 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f8770a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0afa90 con 0x7f876c156ad0 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f8770a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0afd70 con 0x7f876c0cbea0 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f876a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 0x7f876c0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f876a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 0x7f876c0af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55346/0 (socket says 172.21.15.149:55346) 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.069+0000 7f876a800640 1 -- 172.21.15.149:0/3909650424 learned_addr learned my addr 172.21.15.149:0/3909650424 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876a800640 1 -- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 msgr2=0x7f876c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f8761e00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876b200640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c156ad0 0x7f876c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876a800640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876a800640 1 -- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c156ad0 msgr2=0x7f876c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876a800640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c156ad0 0x7f876c06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876a800640 1 -- 172.21.15.149:0/3909650424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754009390 con 0x7f876c06dc80 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876b200640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c156ad0 0x7f876c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f8761e00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:34.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f876a800640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 0x7f876c0af2b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f875c00cb60 tx=0x7f875c001c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c007430 con 0x7f876c06dc80 2024-08-17T02:47:34.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0075b0 con 0x7f876c06dc80 2024-08-17T02:47:34.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0049f0 con 0x7f876c06dc80 2024-08-17T02:47:34.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.070+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c0b0050 con 0x7f876c06dc80 2024-08-17T02:47:34.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.071+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c0b0610 con 0x7f876c06dc80 2024-08-17T02:47:34.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.072+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c0b0800 con 0x7f876c06dc80 2024-08-17T02:47:34.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.072+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f875c00a690 con 0x7f876c06dc80 2024-08-17T02:47:34.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.073+0000 7f8762a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8748065150 0x7f8748067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.073+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f875c081770 con 0x7f876c06dc80 2024-08-17T02:47:34.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.073+0000 7f8761e00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8748065150 0x7f8748067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.074+0000 7f8761e00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8748065150 0x7f8748067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8754034000 tx=0x7f8754032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.077+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f875c04fb60 con 0x7f876c06dc80 2024-08-17T02:47:34.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.311+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f876c071050 con 0x7f876c06dc80 2024-08-17T02:47:34.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.315+0000 7f8762a00640 1 -- 172.21.15.149:0/3909650424 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f875c0180a0 con 0x7f876c06dc80 2024-08-17T02:47:34.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8748065150 msgr2=0x7f8748067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8748065150 0x7f8748067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8754034000 tx=0x7f8754032000 comp rx=0 tx=0).stop 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 msgr2=0x7f876c0af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 0x7f876c0af2b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f875c00cb60 tx=0x7f875c001c90 comp rx=0 tx=0).stop 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 shutdown_connections 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8748065150 0x7f8748067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c156ad0 0x7f876c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cbea0 0x7f876c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 --2- 172.21.15.149:0/3909650424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f876c06dc80 0x7f876c0af2b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 >> 172.21.15.149:0/3909650424 conn(0x7f876c067750 msgr2=0x7f876c155430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 shutdown_connections 2024-08-17T02:47:34.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.318+0000 7f8770a00640 1 -- 172.21.15.149:0/3909650424 wait complete. 2024-08-17T02:47:34.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.484+0000 7f0618a00640 1 Processor -- start 2024-08-17T02:47:34.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.484+0000 7f0618a00640 1 -- start start 2024-08-17T02:47:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0618a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0614159ca0 0x7f06140ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0618a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0618a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06140ccad0 0x7f06140cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0618a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140cd6e0 con 0x7f06140ccad0 2024-08-17T02:47:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0618a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140ccf70 con 0x7f0614159ca0 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0618a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06140cadc0 con 0x7f06140ca8a0 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0613e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06140ccad0 0x7f06140cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0613e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06140ccad0 0x7f06140cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55356/0 (socket says 172.21.15.149:55356) 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0613e00640 1 -- 172.21.15.149:0/357985451 learned_addr learned my addr 172.21.15.149:0/357985451 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.485+0000 7f0613400640 1 --2- 172.21.15.149:0/357985451 >> v2:172.21.15.161:3300/0 conn(0x7f0614159ca0 0x7f06140ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.486+0000 7f060be00640 1 --2- 172.21.15.149:0/357985451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.486+0000 7f0613e00640 1 -- 172.21.15.149:0/357985451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 msgr2=0x7f06140cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.486+0000 7f0613e00640 1 --2- 172.21.15.149:0/357985451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.486+0000 7f0613e00640 1 -- 172.21.15.149:0/357985451 >> v2:172.21.15.161:3300/0 conn(0x7f0614159ca0 msgr2=0x7f06140ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.486+0000 7f0613e00640 1 --2- 172.21.15.149:0/357985451 >> v2:172.21.15.161:3300/0 conn(0x7f0614159ca0 0x7f06140ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.486+0000 7f0613e00640 1 -- 172.21.15.149:0/357985451 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140cb060 con 0x7f06140ccad0 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.487+0000 7f0613e00640 1 --2- 172.21.15.149:0/357985451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06140cdb30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f061408a320 tx=0x7f060c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a438079324151f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.487+0000 7f0612a00640 1 -- 172.21.15.149:0/357985451 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c031400 con 0x7f06140ccad0 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.487+0000 7f0612a00640 1 -- 172.21.15.149:0/357985451 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c02d050 con 0x7f06140ccad0 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.487+0000 7f0612a00640 1 -- 172.21.15.149:0/357985451 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c0317d0 con 0x7f06140ccad0 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 -- 172.21.15.149:0/357985451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 msgr2=0x7f06140cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 --2- 172.21.15.149:0/357985451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06140cdb30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f061408a320 tx=0x7f060c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 -- 172.21.15.149:0/357985451 shutdown_connections 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 --2- 172.21.15.149:0/357985451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06140cdb30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 --2- 172.21.15.149:0/357985451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 --2- 172.21.15.149:0/357985451 >> v2:172.21.15.161:3300/0 conn(0x7f0614159ca0 0x7f06140ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 -- 172.21.15.149:0/357985451 >> 172.21.15.149:0/357985451 conn(0x7f0614098e00 msgr2=0x7f061406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 -- 172.21.15.149:0/357985451 shutdown_connections 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.488+0000 7f0618a00640 1 -- 172.21.15.149:0/357985451 wait complete. 2024-08-17T02:47:34.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.489+0000 7f0618a00640 1 Processor -- start 2024-08-17T02:47:34.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.489+0000 7f0618a00640 1 -- start start 2024-08-17T02:47:34.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f0618a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f0618a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06141540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f0618a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0614159ca0 0x7f0614169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f0618a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061416ca20 con 0x7f06140ccad0 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f0618a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614169a60 con 0x7f0614159ca0 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f0618a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06140c66a0 con 0x7f06140ca8a0 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.490+0000 7f060be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06141540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06141540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55368/0 (socket says 172.21.15.149:55368) 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 -- 172.21.15.149:0/2670484785 learned_addr learned my addr 172.21.15.149:0/2670484785 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f0613400640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f0613e00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0614159ca0 0x7f0614169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 -- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 msgr2=0x7f06140c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 -- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0614159ca0 msgr2=0x7f0614169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0614159ca0 0x7f0614169520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 -- 172.21.15.149:0/2670484785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c009ae0 con 0x7f06140ccad0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060be00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06141540e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00ea20 tx=0x7f05fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00ca10 con 0x7f06140ccad0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00cb70 con 0x7f06140ccad0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.491+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc013470 con 0x7f06140ccad0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.492+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061416c0f0 con 0x7f06140ccad0 2024-08-17T02:47:34.495 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.492+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061416c6b0 con 0x7f06140ccad0 2024-08-17T02:47:34.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.493+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06140cbc70 con 0x7f06140ccad0 2024-08-17T02:47:34.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.493+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f05fc013860 con 0x7f06140ccad0 2024-08-17T02:47:34.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.494+0000 7f060aa00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f05f0065150 0x7f05f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.494+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f05fc082420 con 0x7f06140ccad0 2024-08-17T02:47:34.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.494+0000 7f0613400640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f05f0065150 0x7f05f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.495+0000 7f0613400640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f05f0065150 0x7f05f0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0604009c80 tx=0x7f06040090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.498+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f06140cbc70 con 0x7f06140ccad0 2024-08-17T02:47:34.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.673+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06140cd850 con 0x7f06140ccad0 2024-08-17T02:47:34.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.674+0000 7f060aa00640 1 -- 172.21.15.149:0/2670484785 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f06140cd850 con 0x7f06140ccad0 2024-08-17T02:47:34.676 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:34.676 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":30,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:31.350262+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:34.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.676+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f05f0065150 msgr2=0x7f05f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.676+0000 7f0618a00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f05f0065150 0x7f05f0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0604009c80 tx=0x7f06040090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.676+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 msgr2=0x7f06141540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.676+0000 7f0618a00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06141540e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00ea20 tx=0x7f05fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 shutdown_connections 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f05f0065150 0x7f05f0067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0614159ca0 0x7f0614169520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06140ccad0 0x7f06141540e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 --2- 172.21.15.149:0/2670484785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06140ca8a0 0x7f06140c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 >> 172.21.15.149:0/2670484785 conn(0x7f0614098e00 msgr2=0x7f06141551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 shutdown_connections 2024-08-17T02:47:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.677+0000 7f0618a00640 1 -- 172.21.15.149:0/2670484785 wait complete. 2024-08-17T02:47:34.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:47:34.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:34.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.844+0000 7ff0a1c00640 1 Processor -- start 2024-08-17T02:47:34.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.844+0000 7ff0a1c00640 1 -- start start 2024-08-17T02:47:34.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.845+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c0b2c40 0x7ff09c096a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.845+0000 7ff0a1c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff09c15a320 0x7ff09c096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.845+0000 7ff0a1c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0aacd0 con 0x7ff09c159f50 2024-08-17T02:47:34.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.845+0000 7ff0a1c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0b0b90 con 0x7ff09c15a320 2024-08-17T02:47:34.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.845+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0b0e70 con 0x7ff09c0b2c40 2024-08-17T02:47:34.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff09c15a320 0x7ff09c096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff09c15a320 0x7ff09c096fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55376/0 (socket says 172.21.15.149:55376) 2024-08-17T02:47:34.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 -- 172.21.15.149:0/3787860683 learned_addr learned my addr 172.21.15.149:0/3787860683 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:34.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09a000640 1 --2- 172.21.15.149:0/3787860683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c0b2c40 0x7ff09c096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 -- 172.21.15.149:0/3787860683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c0b2c40 msgr2=0x7ff09c096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 --2- 172.21.15.149:0/3787860683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c0b2c40 0x7ff09c096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 -- 172.21.15.149:0/3787860683 >> v1:172.21.15.161:6789/0 conn(0x7ff09c159f50 legacy=0x7ff09c0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.846+0000 7ff09b400640 1 -- 172.21.15.149:0/3787860683 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0b1150 con 0x7ff09c15a320 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.847+0000 7ff09b400640 1 --2- 172.21.15.149:0/3787860683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c15a320 0x7ff09c096fb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff094009f20 tx=0x7ff094009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1aa15396431956 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.847+0000 7ff099600640 1 -- 172.21.15.149:0/3787860683 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094031400 con 0x7ff09c15a320 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.847+0000 7ff099600640 1 -- 172.21.15.149:0/3787860683 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09402d050 con 0x7ff09c15a320 2024-08-17T02:47:34.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.847+0000 7ff099600640 1 -- 172.21.15.149:0/3787860683 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0940317d0 con 0x7ff09c15a320 2024-08-17T02:47:34.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 -- 172.21.15.149:0/3787860683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c15a320 msgr2=0x7ff09c096fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/3787860683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c15a320 0x7ff09c096fb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff094009f20 tx=0x7ff094009840 comp rx=0 tx=0).stop 2024-08-17T02:47:34.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 -- 172.21.15.149:0/3787860683 shutdown_connections 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/3787860683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c15a320 0x7ff09c096fb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/3787860683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c0b2c40 0x7ff09c096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 -- 172.21.15.149:0/3787860683 >> 172.21.15.149:0/3787860683 conn(0x7ff09c0b30b0 msgr2=0x7ff09c0b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 -- 172.21.15.149:0/3787860683 shutdown_connections 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.848+0000 7ff0a1c00640 1 -- 172.21.15.149:0/3787860683 wait complete. 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.849+0000 7ff0a1c00640 1 Processor -- start 2024-08-17T02:47:34.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 -- start start 2024-08-17T02:47:34.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 0x7ff09c15c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c159f50 0x7ff09c1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff09c15a320 0x7ff09c15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c15cf60 con 0x7ff09c0b2c40 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c15c8a0 con 0x7ff09c15a320 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.850+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c15bed0 con 0x7ff09c159f50 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 0x7ff09c15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09b400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff09c15a320 0x7ff09c15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 0x7ff09c15c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55378/0 (socket says 172.21.15.149:55378) 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 -- 172.21.15.149:0/980133198 learned_addr learned my addr 172.21.15.149:0/980133198 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09b400640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff09c15a320 0x7ff09c15dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:56148/0 (socket says 172.21.15.149:56148) 2024-08-17T02:47:34.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09a000640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c159f50 0x7ff09c1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 -- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c159f50 msgr2=0x7ff09c1534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c159f50 0x7ff09c1534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 -- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff09c15a320 msgr2=0x7ff09c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff09c15a320 0x7ff09c15dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.851+0000 7ff09aa00640 1 -- 172.21.15.149:0/980133198 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094009ae0 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.852+0000 7ff09aa00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 0x7ff09c15c360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c5c0 tx=0x7ff08c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.852+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011590 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.852+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c011710 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.852+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011ad0 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.852+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c153a00 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.852+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c15b880 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.853+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c15b350 con 0x7ff09c0b2c40 2024-08-17T02:47:34.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.854+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff08c01c460 con 0x7ff09c0b2c40 2024-08-17T02:47:34.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.855+0000 7ff092000640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff07c065180 0x7ff07c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.855+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff08c081c40 con 0x7ff09c0b2c40 2024-08-17T02:47:34.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.855+0000 7ff09a000640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff07c065180 0x7ff07c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.857 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.855+0000 7ff09a000640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff07c065180 0x7ff07c067630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0af130 tx=0x7ff0880090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:34.859+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff08c050100 con 0x7ff09c0b2c40 2024-08-17T02:47:35.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.029+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff09c064db0 con 0x7ff09c0b2c40 2024-08-17T02:47:35.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.029+0000 7ff092000640 1 -- 172.21.15.149:0/980133198 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff08c053720 con 0x7ff09c0b2c40 2024-08-17T02:47:35.031 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:47:35.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff07c065180 msgr2=0x7ff07c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff07c065180 0x7ff07c067630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0af130 tx=0x7ff0880090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 msgr2=0x7ff09c15c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 0x7ff09c15c360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c5c0 tx=0x7ff08c007e80 comp rx=0 tx=0).stop 2024-08-17T02:47:35.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 shutdown_connections 2024-08-17T02:47:35.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff07c065180 0x7ff07c067630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff09c15a320 0x7ff09c15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff09c159f50 0x7ff09c1534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 --2- 172.21.15.149:0/980133198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0b2c40 0x7ff09c15c360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 >> 172.21.15.149:0/980133198 conn(0x7ff09c0b30b0 msgr2=0x7ff09c068880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 shutdown_connections 2024-08-17T02:47:35.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.032+0000 7ff0a1c00640 1 -- 172.21.15.149:0/980133198 wait complete. 2024-08-17T02:47:35.049 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:47:35.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.196+0000 7ffba5600640 1 Processor -- start 2024-08-17T02:47:35.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.196+0000 7ffba5600640 1 -- start start 2024-08-17T02:47:35.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.197+0000 7ffba5600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 0x7ffba00c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.197+0000 7ffba5600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00cb7c0 con 0x7ffba00d08d0 2024-08-17T02:47:35.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.197+0000 7ffba5600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00ceb20 con 0x7ffba00cb340 2024-08-17T02:47:35.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.197+0000 7ffba5600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00cf0c0 con 0x7ffba0158ce0 2024-08-17T02:47:35.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb97e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ffba00d08d0 0x7ffba00cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50846/0 (socket says 172.21.15.149:50846) 2024-08-17T02:47:35.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb97e00640 1 -- 172.21.15.149:0/895959760 learned_addr learned my addr 172.21.15.149:0/895959760 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:35.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9ea00640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 0x7ffba00c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930760267 0 0) 0x7ffba00cb7c0 con 0x7ffba00d08d0 2024-08-17T02:47:35.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb840034e0 con 0x7ffba00d08d0 2024-08-17T02:47:35.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1907705292 0 0) 0x7ffb840034e0 con 0x7ffba00d08d0 2024-08-17T02:47:35.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 msgr2=0x7ffba00c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:35.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 0x7ffba00c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 >> v1:172.21.15.161:6789/0 conn(0x7ffba00cb340 legacy=0x7ffba00c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00cede0 con 0x7ffba00d08d0 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7ffb88001470 con 0x7ffba00d08d0 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 >> v1:172.21.15.149:6789/0 conn(0x7ffba00d08d0 legacy=0x7ffba00cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.198+0000 7ffb9e000640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb84003a00 0x7ffb84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9e000640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb84004780 0x7ffb84004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9e000640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 0x7ffb84005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00cf0c0 con 0x7ffb84004780 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8400ba80 con 0x7ffb84003a00 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8400bc40 con 0x7ffba0158ce0 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb97e00640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb84004780 0x7ffb84004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9ea00640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb84003a00 0x7ffb84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb9f400640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 0x7ffb84005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb97e00640 1 -- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 msgr2=0x7ffb84005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:35.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb97e00640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffba0158ce0 0x7ffb84005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb97e00640 1 -- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb84003a00 msgr2=0x7ffb84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:35.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb97e00640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb84003a00 0x7ffb84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.199+0000 7ffb97e00640 1 -- 172.21.15.149:0/895959760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840034e0 con 0x7ffb84004780 2024-08-17T02:47:35.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.200+0000 7ffb97e00640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb84004780 0x7ffb84004bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800c210 tx=0x7ffb88001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297fe8b8f3109e58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.200+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88005960 con 0x7ffb84004780 2024-08-17T02:47:35.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88005ae0 con 0x7ffb84004780 2024-08-17T02:47:35.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffb9e000640 1 -- 172.21.15.149:0/895959760 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88005ea0 con 0x7ffb84004780 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffba5600640 1 -- 172.21.15.149:0/895959760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb84004780 msgr2=0x7ffb84004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffba5600640 1 --2- 172.21.15.149:0/895959760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb84004780 0x7ffb84004bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800c210 tx=0x7ffb88001df0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffb9f400640 1 -- 172.21.15.149:0/895959760 reap_dead start 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffba5600640 1 -- 172.21.15.149:0/895959760 shutdown_connections 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffba5600640 1 -- 172.21.15.149:0/895959760 >> 172.21.15.149:0/895959760 conn(0x7ffba00cfdc0 msgr2=0x7ffba00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffba5600640 1 -- 172.21.15.149:0/895959760 shutdown_connections 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.201+0000 7ffba5600640 1 -- 172.21.15.149:0/895959760 wait complete. 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.203+0000 7ffba5600640 1 Processor -- start 2024-08-17T02:47:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.203+0000 7ffba5600640 1 -- start start 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.203+0000 7ffba5600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb84004780 0x7ffba01497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffba5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 0x7ffba0067850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffba5600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffba009d6b0 0x7ffba0067d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffba5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0169b90 con 0x7ffba009d240 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffba5600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba009c530 con 0x7ffba009d6b0 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffba5600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba009cdb0 con 0x7ffb84004780 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 0x7ffba0067850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 0x7ffba0067850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55400/0 (socket says 172.21.15.149:55400) 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb9ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb84004780 0x7ffba01497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 -- 172.21.15.149:0/3425134874 learned_addr learned my addr 172.21.15.149:0/3425134874 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb9f400640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffba009d6b0 0x7ffba0067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 -- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb84004780 msgr2=0x7ffba01497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb84004780 0x7ffba01497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 -- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffba009d6b0 msgr2=0x7ffba0067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffba009d6b0 0x7ffba0067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.204+0000 7ffb97e00640 1 -- 172.21.15.149:0/3425134874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba01698b0 con 0x7ffba009d240 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.205+0000 7ffb97e00640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 0x7ffba0067850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb8802ae30 tx=0x7ffb88034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.205+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88005960 con 0x7ffba009d240 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.205+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88001430 con 0x7ffba009d240 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.205+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8803e660 con 0x7ffba009d240 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.205+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba009c760 con 0x7ffba009d240 2024-08-17T02:47:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.205+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba0149d00 con 0x7ffba009d240 2024-08-17T02:47:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.206+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba0064db0 con 0x7ffba009d240 2024-08-17T02:47:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.207+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb8803ea90 con 0x7ffba009d240 2024-08-17T02:47:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.207+0000 7ffb96000640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb7c065150 0x7ffb7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.208+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffb880a2bb0 con 0x7ffba009d240 2024-08-17T02:47:35.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.208+0000 7ffb9ea00640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb7c065150 0x7ffb7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.208+0000 7ffb9ea00640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb7c065150 0x7ffb7c067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006e70 tx=0x7ffb900090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.212+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffb88071090 con 0x7ffba009d240 2024-08-17T02:47:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.385+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffba009cef0 con 0x7ffba009d240 2024-08-17T02:47:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.386+0000 7ffb96000640 1 -- 172.21.15.149:0/3425134874 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffb88005e60 con 0x7ffba009d240 2024-08-17T02:47:35.387 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:35.387 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2024-08-17T02:47:35.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:35.388 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2024-08-17T02:47:35.388 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2024-08-17T02:47:35.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:35.388 INFO:teuthology.orchestra.run.smithi149.stdout:] 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb7c065150 msgr2=0x7ffb7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb7c065150 0x7ffb7c067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006e70 tx=0x7ffb900090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 msgr2=0x7ffba0067850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 0x7ffba0067850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb8802ae30 tx=0x7ffb88034000 comp rx=0 tx=0).stop 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 shutdown_connections 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ffb7c065150 0x7ffb7c067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffba009d6b0 0x7ffba0067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba009d240 0x7ffba0067850 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 --2- 172.21.15.149:0/3425134874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb84004780 0x7ffba01497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 >> 172.21.15.149:0/3425134874 conn(0x7ffba00cfdc0 msgr2=0x7ffba0157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 shutdown_connections 2024-08-17T02:47:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.388+0000 7ffba5600640 1 -- 172.21.15.149:0/3425134874 wait complete. 2024-08-17T02:47:35.404 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:47:35.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:47:35.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.556+0000 7efe8cc00640 1 Processor -- start 2024-08-17T02:47:35.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.556+0000 7efe8cc00640 1 -- start start 2024-08-17T02:47:35.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe8cc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efe881543a0 0x7efe880cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe8cc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880ca160 con 0x7efe8806e3e0 2024-08-17T02:47:35.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe8cc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880ca440 con 0x7efe88154770 2024-08-17T02:47:35.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe8cc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880ca720 con 0x7efe881543a0 2024-08-17T02:47:35.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe87e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7efe8806e3e0 0x7efe88154b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:50850/0 (socket says 172.21.15.149:50850) 2024-08-17T02:47:35.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe87e00640 1 -- 172.21.15.149:0/3336344452 learned_addr learned my addr 172.21.15.149:0/3336344452 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:35.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe87400640 1 --2- 172.21.15.149:0/3336344452 >> v2:172.21.15.161:3300/0 conn(0x7efe881543a0 0x7efe880cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833040077 0 0) 0x7efe880ca160 con 0x7efe8806e3e0 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.558+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe6c0034e0 con 0x7efe8806e3e0 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.559+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005593806 0 0) 0x7efe880ca440 con 0x7efe88154770 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.559+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe880ca160 con 0x7efe88154770 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.559+0000 7efe87400640 1 -- 172.21.15.149:0/3336344452 >> v1:172.21.15.161:6789/0 conn(0x7efe88154770 legacy=0x7efe8806dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.559+0000 7efe87400640 1 -- 172.21.15.149:0/3336344452 >> v1:172.21.15.149:6789/0 conn(0x7efe8806e3e0 legacy=0x7efe88154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.559+0000 7efe87400640 1 -- 172.21.15.149:0/3336344452 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880caa00 con 0x7efe881543a0 2024-08-17T02:47:35.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.560+0000 7efe87400640 1 --2- 172.21.15.149:0/3336344452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe881543a0 0x7efe880cb200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe78009850 tx=0x7efe780090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55629a1fa36009c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.560+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7802ae20 con 0x7efe881543a0 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.560+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78032440 con 0x7efe881543a0 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.560+0000 7efe86000640 1 -- 172.21.15.149:0/3336344452 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780327e0 con 0x7efe881543a0 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 -- 172.21.15.149:0/3336344452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe881543a0 msgr2=0x7efe880cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 --2- 172.21.15.149:0/3336344452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe881543a0 0x7efe880cb200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe78009850 tx=0x7efe780090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 -- 172.21.15.149:0/3336344452 shutdown_connections 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 --2- 172.21.15.149:0/3336344452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe881543a0 0x7efe880cb200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 -- 172.21.15.149:0/3336344452 >> 172.21.15.149:0/3336344452 conn(0x7efe88067750 msgr2=0x7efe8806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 -- 172.21.15.149:0/3336344452 shutdown_connections 2024-08-17T02:47:35.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.561+0000 7efe8cc00640 1 -- 172.21.15.149:0/3336344452 wait complete. 2024-08-17T02:47:35.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.562+0000 7efe8cc00640 1 Processor -- start 2024-08-17T02:47:35.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.562+0000 7efe8cc00640 1 -- start start 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe8cc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe8806e3e0 0x7efe8816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe8cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 0x7efe880c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe8cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe88154770 0x7efe881675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe8cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88167140 con 0x7efe881543a0 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe8cc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8816a930 con 0x7efe88154770 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe8cc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8816abb0 con 0x7efe8806e3e0 2024-08-17T02:47:35.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.563+0000 7efe86a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 0x7efe880c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe87400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe8806e3e0 0x7efe8816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 0x7efe880c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55414/0 (socket says 172.21.15.149:55414) 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 -- 172.21.15.149:0/682544005 learned_addr learned my addr 172.21.15.149:0/682544005 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe87e00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe88154770 0x7efe881675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 -- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe8806e3e0 msgr2=0x7efe8816a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe8806e3e0 0x7efe8816a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 -- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe88154770 msgr2=0x7efe881675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe88154770 0x7efe881675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 -- 172.21.15.149:0/682544005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009390 con 0x7efe881543a0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe86a00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 0x7efe880c5be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c4e0 tx=0x7efe74007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74016070 con 0x7efe881543a0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74011590 con 0x7efe881543a0 2024-08-17T02:47:35.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8816ae90 con 0x7efe881543a0 2024-08-17T02:47:35.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.564+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74011950 con 0x7efe881543a0 2024-08-17T02:47:35.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.565+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe88166d90 con 0x7efe881543a0 2024-08-17T02:47:35.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.566+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe881672f0 con 0x7efe881543a0 2024-08-17T02:47:35.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.566+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efe74012420 con 0x7efe881543a0 2024-08-17T02:47:35.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.567+0000 7efe7ea00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efe68065150 0x7efe68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.567+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efe740819d0 con 0x7efe881543a0 2024-08-17T02:47:35.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.568+0000 7efe87400640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efe68065150 0x7efe68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.568+0000 7efe87400640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efe68065150 0x7efe68067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe78034000 tx=0x7efe78032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.571+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efe881672f0 con 0x7efe881543a0 2024-08-17T02:47:35.748 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:35.747+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe881672f0 con 0x7efe881543a0 2024-08-17T02:47:36.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.475+0000 7efe7ea00640 1 -- 172.21.15.149:0/682544005 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe881672f0 con 0x7efe881543a0 2024-08-17T02:47:36.477 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efe68065150 msgr2=0x7efe68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efe68065150 0x7efe68067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe78034000 tx=0x7efe78032000 comp rx=0 tx=0).stop 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 msgr2=0x7efe880c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 0x7efe880c5be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c4e0 tx=0x7efe74007d50 comp rx=0 tx=0).stop 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 shutdown_connections 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efe68065150 0x7efe68067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe88154770 0x7efe881675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe881543a0 0x7efe880c5be0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 --2- 172.21.15.149:0/682544005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe8806e3e0 0x7efe8816a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 >> 172.21.15.149:0/682544005 conn(0x7efe88067750 msgr2=0x7efe88156fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 shutdown_connections 2024-08-17T02:47:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.479+0000 7efe8cc00640 1 -- 172.21.15.149:0/682544005 wait complete. 2024-08-17T02:47:36.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:47:36.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.656+0000 7f807a400640 1 Processor -- start 2024-08-17T02:47:36.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.656+0000 7f807a400640 1 -- start start 2024-08-17T02:47:36.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f807a400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f807a400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80740caa40 0x7f80740c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f807a400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80740cb4c0 con 0x7f8074158db0 2024-08-17T02:47:36.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f807a400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740cae90 con 0x7f80740caa40 2024-08-17T02:47:36.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f807a400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80740cf770 con 0x7f80740cf290 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f8073e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80740caa40 0x7f80740c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f8073e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80740caa40 0x7f80740c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55426/0 (socket says 172.21.15.149:55426) 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.657+0000 7f8073e00640 1 -- 172.21.15.149:0/2163217879 learned_addr learned my addr 172.21.15.149:0/2163217879 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.658+0000 7f8072a00640 1 --2- 172.21.15.149:0/2163217879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.658+0000 7f8073e00640 1 -- 172.21.15.149:0/2163217879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 msgr2=0x7f8074159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.658+0000 7f8073e00640 1 --2- 172.21.15.149:0/2163217879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.658+0000 7f8073e00640 1 -- 172.21.15.149:0/2163217879 >> v1:172.21.15.161:6789/0 conn(0x7f8074158db0 legacy=0x7f80740ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.658+0000 7f8073e00640 1 -- 172.21.15.149:0/2163217879 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740cfa50 con 0x7f80740caa40 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.659+0000 7f8073e00640 1 --2- 172.21.15.149:0/2163217879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80740caa40 0x7f80740c6da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f806c009f20 tx=0x7f806c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce5aa17a06f3b4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.659+0000 7f8072000640 1 -- 172.21.15.149:0/2163217879 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c032450 con 0x7f80740caa40 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.659+0000 7f8072000640 1 -- 172.21.15.149:0/2163217879 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c0325b0 con 0x7f80740caa40 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.659+0000 7f8072000640 1 -- 172.21.15.149:0/2163217879 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c032990 con 0x7f80740caa40 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 -- 172.21.15.149:0/2163217879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80740caa40 msgr2=0x7f80740c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 --2- 172.21.15.149:0/2163217879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80740caa40 0x7f80740c6da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f806c009f20 tx=0x7f806c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 -- 172.21.15.149:0/2163217879 shutdown_connections 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 --2- 172.21.15.149:0/2163217879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80740caa40 0x7f80740c6da0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 --2- 172.21.15.149:0/2163217879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 -- 172.21.15.149:0/2163217879 >> 172.21.15.149:0/2163217879 conn(0x7f80740cfd90 msgr2=0x7f80740d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 -- 172.21.15.149:0/2163217879 shutdown_connections 2024-08-17T02:47:36.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.660+0000 7f807a400640 1 -- 172.21.15.149:0/2163217879 wait complete. 2024-08-17T02:47:36.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.661+0000 7f807a400640 1 Processor -- start 2024-08-17T02:47:36.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.661+0000 7f807a400640 1 -- start start 2024-08-17T02:47:36.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.662+0000 7f807a400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80740caa40 0x7f807409c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.662+0000 7f807a400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.662+0000 7f807a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 0x7f8074150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.662+0000 7f807a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807414de00 con 0x7f8074158db0 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.662+0000 7f807a400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074099f90 con 0x7f80740caa40 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.662+0000 7f807a400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807409a270 con 0x7f80740cf290 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 0x7f8074150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8072a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8072a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:45450/0 (socket says 172.21.15.149:45450) 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 0x7f8074150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55434/0 (socket says 172.21.15.149:55434) 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8072a00640 1 -- 172.21.15.149:0/1897942150 learned_addr learned my addr 172.21.15.149:0/1897942150 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80740caa40 0x7f807409c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 -- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 msgr2=0x7f8074150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 -- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80740caa40 msgr2=0x7f807409c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80740caa40 0x7f807409c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8073e00640 1 -- 172.21.15.149:0/1897942150 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009ae0 con 0x7f8074158db0 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.663+0000 7f8072a00640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.664+0000 7f8073e00640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 0x7f8074150950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f806c031000 tx=0x7f806c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.664+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c032450 con 0x7f8074158db0 2024-08-17T02:47:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.664+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c008e50 con 0x7f8074158db0 2024-08-17T02:47:36.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.664+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c03c660 con 0x7f8074158db0 2024-08-17T02:47:36.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.664+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807409a550 con 0x7f8074158db0 2024-08-17T02:47:36.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.664+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807409ab10 con 0x7f8074158db0 2024-08-17T02:47:36.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.665+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80740c6da0 con 0x7f8074158db0 2024-08-17T02:47:36.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.666+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f806c039050 con 0x7f8074158db0 2024-08-17T02:47:36.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.667+0000 7f806aa00640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8054065150 0x7f8054067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.667+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f806c02e050 con 0x7f8074158db0 2024-08-17T02:47:36.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.667+0000 7f8073400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8054065150 0x7f8054067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.668+0000 7f8073400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8054065150 0x7f8054067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8064007fd0 tx=0x7f8064007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.671+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f806c071790 con 0x7f8074158db0 2024-08-17T02:47:36.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:36.842+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f80740c6da0 con 0x7f8074158db0 2024-08-17T02:47:37.485 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.484+0000 7f806aa00640 1 -- 172.21.15.149:0/1897942150 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f80740c6da0 con 0x7f8074158db0 2024-08-17T02:47:37.486 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2024-08-17T02:47:37.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.488+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8054065150 msgr2=0x7f8054067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.488+0000 7f807a400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8054065150 0x7f8054067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8064007fd0 tx=0x7f8064007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:37.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.488+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 msgr2=0x7f8074150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.488+0000 7f807a400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 0x7f8074150950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f806c031000 tx=0x7f806c037000 comp rx=0 tx=0).stop 2024-08-17T02:47:37.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 shutdown_connections 2024-08-17T02:47:37.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8054065150 0x7f8054067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8074158db0 0x7f8074150950 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80740cf290 0x7f8074150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 --2- 172.21.15.149:0/1897942150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80740caa40 0x7f807409c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 >> 172.21.15.149:0/1897942150 conn(0x7f80740cfd90 msgr2=0x7f8074157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.489+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 shutdown_connections 2024-08-17T02:47:37.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.492+0000 7f807a400640 1 -- 172.21.15.149:0/1897942150 wait complete. 2024-08-17T02:47:37.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:47:37.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.670+0000 7f497ea00640 1 Processor -- start 2024-08-17T02:47:37.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.670+0000 7f497ea00640 1 -- start start 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4978155660 0x7f49780c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497ea00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49780afc40 con 0x7f49780adfb0 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497ea00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49780af030 con 0x7f4978155a30 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497ea00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49780af310 con 0x7f4978155660 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497cc00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f49780adfb0 0x7f49780ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57494/0 (socket says 172.21.15.149:57494) 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497cc00640 1 -- 172.21.15.149:0/462218617 learned_addr learned my addr 172.21.15.149:0/462218617 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:37.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.671+0000 7f497d600640 1 --2- 172.21.15.149:0/462218617 >> v2:172.21.15.161:3300/0 conn(0x7f4978155660 0x7f49780c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348930957 0 0) 0x7f49780afc40 con 0x7f49780adfb0 2024-08-17T02:47:37.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49600034e0 con 0x7f49780adfb0 2024-08-17T02:47:37.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196888279 0 0) 0x7f49780af030 con 0x7f4978155a30 2024-08-17T02:47:37.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49780afc40 con 0x7f4978155a30 2024-08-17T02:47:37.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f497d600640 1 -- 172.21.15.149:0/462218617 >> v1:172.21.15.161:6789/0 conn(0x7f4978155a30 legacy=0x7f497806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f497d600640 1 -- 172.21.15.149:0/462218617 >> v1:172.21.15.149:6789/0 conn(0x7f49780adfb0 legacy=0x7f49780ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.672+0000 7f497d600640 1 -- 172.21.15.149:0/462218617 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780af5f0 con 0x7f4978155660 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.673+0000 7f497d600640 1 --2- 172.21.15.149:0/462218617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4978155660 0x7f49780c7fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f496c009e60 tx=0x7f496c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6c42a1dd66f74b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.673+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c007550 con 0x7f4978155660 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.673+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c02d050 con 0x7f4978155660 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.673+0000 7f4977e00640 1 -- 172.21.15.149:0/462218617 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c007900 con 0x7f4978155660 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 -- 172.21.15.149:0/462218617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4978155660 msgr2=0x7f49780c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 --2- 172.21.15.149:0/462218617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4978155660 0x7f49780c7fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f496c009e60 tx=0x7f496c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 -- 172.21.15.149:0/462218617 shutdown_connections 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 --2- 172.21.15.149:0/462218617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4978155660 0x7f49780c7fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 -- 172.21.15.149:0/462218617 >> 172.21.15.149:0/462218617 conn(0x7f4978066cd0 msgr2=0x7f49780670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 -- 172.21.15.149:0/462218617 shutdown_connections 2024-08-17T02:47:37.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.674+0000 7f497ea00640 1 -- 172.21.15.149:0/462218617 wait complete. 2024-08-17T02:47:37.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.675+0000 7f497ea00640 1 Processor -- start 2024-08-17T02:47:37.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 -- start start 2024-08-17T02:47:37.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49780adfb0 0x7f49780aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 0x7f49781494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4978155a30 0x7f4978157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49781508c0 con 0x7f4978155660 2024-08-17T02:47:37.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497814fcb0 con 0x7f49780adfb0 2024-08-17T02:47:37.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.676+0000 7f497ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497814ff90 con 0x7f4978155a30 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 0x7f49781494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 0x7f49781494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56266/0 (socket says 172.21.15.149:56266) 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 -- 172.21.15.149:0/1098689187 learned_addr learned my addr 172.21.15.149:0/1098689187 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497d600640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49780adfb0 0x7f49780aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497e000640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4978155a30 0x7f4978157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 -- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4978155a30 msgr2=0x7f4978157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4978155a30 0x7f4978157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 -- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49780adfb0 msgr2=0x7f49780aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49780adfb0 0x7f49780aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 -- 172.21.15.149:0/1098689187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009a20 con 0x7f4978155660 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.677+0000 7f497cc00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 0x7f49781494a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f496400c790 tx=0x7f4964007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.678+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400ce60 con 0x7f4978155660 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.678+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964005870 con 0x7f4978155660 2024-08-17T02:47:37.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.678+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964005bf0 con 0x7f4978155660 2024-08-17T02:47:37.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.678+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4978150270 con 0x7f4978155660 2024-08-17T02:47:37.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.678+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780aa7d0 con 0x7f4978155660 2024-08-17T02:47:37.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.679+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4978150a70 con 0x7f4978155660 2024-08-17T02:47:37.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.680+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4964005d50 con 0x7f4978155660 2024-08-17T02:47:37.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.681+0000 7f4974c00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4958065180 0x7f4958067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.681+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4964081e00 con 0x7f4978155660 2024-08-17T02:47:37.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.681+0000 7f497d600640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4958065180 0x7f4958067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.682+0000 7f497d600640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4958065180 0x7f4958067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f496c034000 tx=0x7f496c037000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.685+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4978150a70 con 0x7f4978155660 2024-08-17T02:47:37.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:37.894+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4978071050 con 0x7f4978155660 2024-08-17T02:47:38.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.501+0000 7f4974c00640 1 -- 172.21.15.149:0/1098689187 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4964053a30 con 0x7f4978155660 2024-08-17T02:47:38.503 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:47:38.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.505+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4958065180 msgr2=0x7f4958067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.505+0000 7f497ea00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4958065180 0x7f4958067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f496c034000 tx=0x7f496c037000 comp rx=0 tx=0).stop 2024-08-17T02:47:38.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.505+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 msgr2=0x7f49781494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.505+0000 7f497ea00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 0x7f49781494a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f496400c790 tx=0x7f4964007db0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.507+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 shutdown_connections 2024-08-17T02:47:38.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.507+0000 7f497ea00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4958065180 0x7f4958067630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.507+0000 7f497ea00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4978155a30 0x7f4978157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.507+0000 7f497ea00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978155660 0x7f49781494a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.507+0000 7f497ea00640 1 --2- 172.21.15.149:0/1098689187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49780adfb0 0x7f49780aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.507+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 >> 172.21.15.149:0/1098689187 conn(0x7f4978066cd0 msgr2=0x7f4978156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.508+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 shutdown_connections 2024-08-17T02:47:38.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.508+0000 7f497ea00640 1 -- 172.21.15.149:0/1098689187 wait complete. 2024-08-17T02:47:38.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.686+0000 7fd79e200640 1 Processor -- start 2024-08-17T02:47:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.687+0000 7fd79e200640 1 -- start start 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd79e200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd798155a20 0x7fd7980adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd79e200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd79806df00 0x7fd7980ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd79e200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd798156670 con 0x7fd798155df0 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd79e200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7980b0350 con 0x7fd798155a20 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd79e200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79806e5e0 con 0x7fd79806df00 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd797400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd798155a20 0x7fd7980adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd78ea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd798155df0 0x7fd79806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57496/0 (socket says 172.21.15.149:57496) 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd78ea00640 1 -- 172.21.15.149:0/3529986191 learned_addr learned my addr 172.21.15.149:0/3529986191 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.688+0000 7fd797e00640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd79806df00 0x7fd7980ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.689+0000 7fd797400640 1 -- 172.21.15.149:0/3529986191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd79806df00 msgr2=0x7fd7980ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.689+0000 7fd797400640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd79806df00 0x7fd7980ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.689+0000 7fd797400640 1 -- 172.21.15.149:0/3529986191 >> v1:172.21.15.149:6789/0 conn(0x7fd798155df0 legacy=0x7fd79806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.689+0000 7fd797400640 1 -- 172.21.15.149:0/3529986191 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79806e8c0 con 0x7fd798155a20 2024-08-17T02:47:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.689+0000 7fd797e00640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd79806df00 0x7fd7980ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.690+0000 7fd797400640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155a20 0x7fd7980adf10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd788009850 tx=0x7fd7880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba34e47ee44ccff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.690+0000 7fd796a00640 1 -- 172.21.15.149:0/3529986191 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78802ad90 con 0x7fd798155a20 2024-08-17T02:47:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.690+0000 7fd796a00640 1 -- 172.21.15.149:0/3529986191 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788032440 con 0x7fd798155a20 2024-08-17T02:47:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.690+0000 7fd796a00640 1 -- 172.21.15.149:0/3529986191 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788032820 con 0x7fd798155a20 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.690+0000 7fd79e200640 1 -- 172.21.15.149:0/3529986191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155a20 msgr2=0x7fd7980adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.690+0000 7fd79e200640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155a20 0x7fd7980adf10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd788009850 tx=0x7fd7880090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.691+0000 7fd79e200640 1 -- 172.21.15.149:0/3529986191 shutdown_connections 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.691+0000 7fd79e200640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd79806df00 0x7fd7980ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.691+0000 7fd79e200640 1 --2- 172.21.15.149:0/3529986191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155a20 0x7fd7980adf10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.691+0000 7fd79e200640 1 -- 172.21.15.149:0/3529986191 >> 172.21.15.149:0/3529986191 conn(0x7fd7980cb9b0 msgr2=0x7fd7980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.691+0000 7fd79e200640 1 -- 172.21.15.149:0/3529986191 shutdown_connections 2024-08-17T02:47:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.691+0000 7fd79e200640 1 -- 172.21.15.149:0/3529986191 wait complete. 2024-08-17T02:47:38.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.692+0000 7fd79e200640 1 Processor -- start 2024-08-17T02:47:38.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.692+0000 7fd79e200640 1 -- start start 2024-08-17T02:47:38.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd79e200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd79806df00 0x7fd79816a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd79e200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd798155a20 0x7fd7981519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd79e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 0x7fd7980cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd79e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd798169c90 con 0x7fd798155df0 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd79e200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd798151f00 con 0x7fd79806df00 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd79e200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79815d710 con 0x7fd798155a20 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.693+0000 7fd797e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 0x7fd7980cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 0x7fd7980cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56290/0 (socket says 172.21.15.149:56290) 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 -- 172.21.15.149:0/1419360358 learned_addr learned my addr 172.21.15.149:0/1419360358 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797400640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd79806df00 0x7fd79816a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd78ea00640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd798155a20 0x7fd7981519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 -- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd798155a20 msgr2=0x7fd7981519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd798155a20 0x7fd7981519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 -- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd79806df00 msgr2=0x7fd79816a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd79806df00 0x7fd79816a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 -- 172.21.15.149:0/1419360358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788009390 con 0x7fd798155df0 2024-08-17T02:47:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797400640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd79806df00 0x7fd79816a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd797e00640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 0x7fd7980cb180 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd79000d180 tx=0x7fd790009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.694+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790015440 con 0x7fd798155df0 2024-08-17T02:47:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.695+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79000f040 con 0x7fd798155df0 2024-08-17T02:47:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.695+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790015810 con 0x7fd798155df0 2024-08-17T02:47:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.695+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79815d9f0 con 0x7fd798155df0 2024-08-17T02:47:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.695+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd798169640 con 0x7fd798155df0 2024-08-17T02:47:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.696+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79815df00 con 0x7fd798155df0 2024-08-17T02:47:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.697+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd79001e3b0 con 0x7fd798155df0 2024-08-17T02:47:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.697+0000 7fd78f400640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd774065180 0x7fd774067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.698+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd790082e40 con 0x7fd798155df0 2024-08-17T02:47:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.698+0000 7fd797400640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd774065180 0x7fd774067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.698+0000 7fd797400640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd774065180 0x7fd774067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd788034000 tx=0x7fd788032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.702+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd79815df00 con 0x7fd798155df0 2024-08-17T02:47:38.876 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.874+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd79815ded0 con 0x7fd798155df0 2024-08-17T02:47:38.877 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.875+0000 7fd78f400640 1 -- 172.21.15.149:0/1419360358 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fd790050f00 con 0x7fd798155df0 2024-08-17T02:47:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:38.877 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":33,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:37.896325+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:38.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd774065180 msgr2=0x7fd774067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd774065180 0x7fd774067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd788034000 tx=0x7fd788032000 comp rx=0 tx=0).stop 2024-08-17T02:47:38.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 msgr2=0x7fd7980cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 0x7fd7980cb180 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd79000d180 tx=0x7fd790009a50 comp rx=0 tx=0).stop 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 shutdown_connections 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd774065180 0x7fd774067630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd798155df0 0x7fd7980cb180 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd798155a20 0x7fd7981519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 --2- 172.21.15.149:0/1419360358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd79806df00 0x7fd79816a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.877+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 >> 172.21.15.149:0/1419360358 conn(0x7fd7980cb9b0 msgr2=0x7fd798154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.878+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 shutdown_connections 2024-08-17T02:47:38.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:38.878+0000 7fd79e200640 1 -- 172.21.15.149:0/1419360358 wait complete. 2024-08-17T02:47:38.895 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:39.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.043+0000 7feb54200640 1 Processor -- start 2024-08-17T02:47:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.043+0000 7feb54200640 1 -- start start 2024-08-17T02:47:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.044+0000 7feb54200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c0caa40 0x7feb4c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.044+0000 7feb54200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0cb560 con 0x7feb4c159350 2024-08-17T02:47:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.044+0000 7feb54200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0cf7e0 con 0x7feb4c158f80 2024-08-17T02:47:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.044+0000 7feb54200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0cfac0 con 0x7feb4c0caa40 2024-08-17T02:47:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.044+0000 7feb52200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7feb4c159350 0x7feb4c0ad380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57506/0 (socket says 172.21.15.149:57506) 2024-08-17T02:47:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb52200640 1 -- 172.21.15.149:0/1113515725 learned_addr learned my addr 172.21.15.149:0/1113515725 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb50e00640 1 --2- 172.21.15.149:0/1113515725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c0caa40 0x7feb4c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017967548 0 0) 0x7feb4c0cb560 con 0x7feb4c159350 2024-08-17T02:47:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb340034e0 con 0x7feb4c159350 2024-08-17T02:47:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326596529 0 0) 0x7feb4c0cf7e0 con 0x7feb4c158f80 2024-08-17T02:47:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb4c0cb560 con 0x7feb4c158f80 2024-08-17T02:47:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb50e00640 1 -- 172.21.15.149:0/1113515725 >> v1:172.21.15.161:6789/0 conn(0x7feb4c158f80 legacy=0x7feb4c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb50e00640 1 -- 172.21.15.149:0/1113515725 >> v1:172.21.15.149:6789/0 conn(0x7feb4c159350 legacy=0x7feb4c0ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.045+0000 7feb50e00640 1 -- 172.21.15.149:0/1113515725 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0caf10 con 0x7feb4c0caa40 2024-08-17T02:47:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.046+0000 7feb50e00640 1 --2- 172.21.15.149:0/1113515725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c0caa40 0x7feb4c0ace40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb38009880 tx=0x7feb380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40adf81fb843208c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.047+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3802ae10 con 0x7feb4c0caa40 2024-08-17T02:47:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.047+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38032440 con 0x7feb4c0caa40 2024-08-17T02:47:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.047+0000 7feb4be00640 1 -- 172.21.15.149:0/1113515725 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38032820 con 0x7feb4c0caa40 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 -- 172.21.15.149:0/1113515725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c0caa40 msgr2=0x7feb4c0ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 --2- 172.21.15.149:0/1113515725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c0caa40 0x7feb4c0ace40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb38009880 tx=0x7feb380090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 -- 172.21.15.149:0/1113515725 shutdown_connections 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 --2- 172.21.15.149:0/1113515725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c0caa40 0x7feb4c0ace40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 -- 172.21.15.149:0/1113515725 >> 172.21.15.149:0/1113515725 conn(0x7feb4c0cfd90 msgr2=0x7feb4c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 -- 172.21.15.149:0/1113515725 shutdown_connections 2024-08-17T02:47:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.048+0000 7feb54200640 1 -- 172.21.15.149:0/1113515725 wait complete. 2024-08-17T02:47:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.049+0000 7feb54200640 1 Processor -- start 2024-08-17T02:47:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.049+0000 7feb54200640 1 -- start start 2024-08-17T02:47:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb54200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 0x7feb4c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb54200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb4c158f80 0x7feb4c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb54200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c159350 0x7feb4c0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb54200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c15dcd0 con 0x7feb4c0caa40 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb54200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c15d0c0 con 0x7feb4c158f80 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb54200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c15d3a0 con 0x7feb4c159350 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb51800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 0x7feb4c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb51800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 0x7feb4c155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56306/0 (socket says 172.21.15.149:56306) 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.050+0000 7feb51800640 1 -- 172.21.15.149:0/1340521759 learned_addr learned my addr 172.21.15.149:0/1340521759 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb50e00640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb4c158f80 0x7feb4c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb52200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c159350 0x7feb4c0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb51800640 1 -- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c159350 msgr2=0x7feb4c0c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb51800640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c159350 0x7feb4c0c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb51800640 1 -- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb4c158f80 msgr2=0x7feb4c0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb51800640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb4c158f80 0x7feb4c0b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb51800640 1 -- 172.21.15.149:0/1340521759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38009390 con 0x7feb4c0caa40 2024-08-17T02:47:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb50e00640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb4c158f80 0x7feb4c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb51800640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 0x7feb4c155130 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feb4000c490 tx=0x7feb40007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40011590 con 0x7feb4c0caa40 2024-08-17T02:47:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40011710 con 0x7feb4c0caa40 2024-08-17T02:47:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40011ad0 con 0x7feb4c0caa40 2024-08-17T02:47:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.051+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c15d680 con 0x7feb4c0caa40 2024-08-17T02:47:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.052+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c15e160 con 0x7feb4c0caa40 2024-08-17T02:47:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.053+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c064db0 con 0x7feb4c0caa40 2024-08-17T02:47:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.053+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feb4001c460 con 0x7feb4c0caa40 2024-08-17T02:47:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.054+0000 7feb48c00640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7feb2c065150 0x7feb2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.054+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb40082190 con 0x7feb4c0caa40 2024-08-17T02:47:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.054+0000 7feb50e00640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7feb2c065150 0x7feb2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.055+0000 7feb50e00640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7feb2c065150 0x7feb2c067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feb38034000 tx=0x7feb38032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.058+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb400501b0 con 0x7feb4c0caa40 2024-08-17T02:47:39.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.234+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb4c0d0700 con 0x7feb4c0caa40 2024-08-17T02:47:39.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.235+0000 7feb48c00640 1 -- 172.21.15.149:0/1340521759 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15411 (secure 0 0 0) 0x7feb400537d0 con 0x7feb4c0caa40 2024-08-17T02:47:39.237 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:39.237 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":33,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:37.896325+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7feb2c065150 msgr2=0x7feb2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7feb2c065150 0x7feb2c067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feb38034000 tx=0x7feb38032000 comp rx=0 tx=0).stop 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 msgr2=0x7feb4c155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 0x7feb4c155130 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feb4000c490 tx=0x7feb40007d30 comp rx=0 tx=0).stop 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 shutdown_connections 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7feb2c065150 0x7feb2c067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb4c159350 0x7feb4c0c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb4c158f80 0x7feb4c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 --2- 172.21.15.149:0/1340521759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c0caa40 0x7feb4c155130 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 >> 172.21.15.149:0/1340521759 conn(0x7feb4c0cfd90 msgr2=0x7feb4c1560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 shutdown_connections 2024-08-17T02:47:39.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.237+0000 7feb54200640 1 -- 172.21.15.149:0/1340521759 wait complete. 2024-08-17T02:47:39.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:47:39.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.406+0000 7f34dc800640 1 Processor -- start 2024-08-17T02:47:39.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.406+0000 7f34dc800640 1 -- start start 2024-08-17T02:47:39.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.407+0000 7f34dc800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34d40c7db0 0x7f34d40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.407+0000 7f34dc800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d41598f0 con 0x7f34d4155a80 2024-08-17T02:47:39.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.407+0000 7f34dc800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d4159bd0 con 0x7f34d4155e50 2024-08-17T02:47:39.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.407+0000 7f34dc800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d4159eb0 con 0x7f34d40c7db0 2024-08-17T02:47:39.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.407+0000 7f34d9e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f34d4155a80 0x7f34d406dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57510/0 (socket says 172.21.15.149:57510) 2024-08-17T02:47:39.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.407+0000 7f34d9e00640 1 -- 172.21.15.149:0/2455533287 learned_addr learned my addr 172.21.15.149:0/2455533287 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:39.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d9400640 1 --2- 172.21.15.149:0/2455533287 >> v2:172.21.15.161:3300/0 conn(0x7f34d40c7db0 0x7f34d40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036358373 0 0) 0x7f34d41598f0 con 0x7f34d4155a80 2024-08-17T02:47:39.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34bc0034e0 con 0x7f34d4155a80 2024-08-17T02:47:39.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526200636 0 0) 0x7f34d4159bd0 con 0x7f34d4155e50 2024-08-17T02:47:39.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d41598f0 con 0x7f34d4155e50 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d9400640 1 -- 172.21.15.149:0/2455533287 >> v1:172.21.15.161:6789/0 conn(0x7f34d4155e50 legacy=0x7f34d40aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d9400640 1 -- 172.21.15.149:0/2455533287 >> v1:172.21.15.149:6789/0 conn(0x7f34d4155a80 legacy=0x7f34d406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.408+0000 7f34d9400640 1 -- 172.21.15.149:0/2455533287 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d415a190 con 0x7f34d40c7db0 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.409+0000 7f34d9400640 1 --2- 172.21.15.149:0/2455533287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d40c7db0 0x7f34d40c8bd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009850 tx=0x7f34c40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e47817417ebd2f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.410+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4032440 con 0x7f34d40c7db0 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.410+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c40325a0 con 0x7f34d40c7db0 2024-08-17T02:47:39.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.410+0000 7f34d8a00640 1 -- 172.21.15.149:0/2455533287 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4032940 con 0x7f34d40c7db0 2024-08-17T02:47:39.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.410+0000 7f34dc800640 1 -- 172.21.15.149:0/2455533287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d40c7db0 msgr2=0x7f34d40c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.410+0000 7f34dc800640 1 --2- 172.21.15.149:0/2455533287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d40c7db0 0x7f34d40c8bd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009850 tx=0x7f34c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.411+0000 7f34dc800640 1 -- 172.21.15.149:0/2455533287 shutdown_connections 2024-08-17T02:47:39.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.411+0000 7f34dc800640 1 --2- 172.21.15.149:0/2455533287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d40c7db0 0x7f34d40c8bd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.411+0000 7f34dc800640 1 -- 172.21.15.149:0/2455533287 >> 172.21.15.149:0/2455533287 conn(0x7f34d4067750 msgr2=0x7f34d40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.411+0000 7f34dc800640 1 -- 172.21.15.149:0/2455533287 shutdown_connections 2024-08-17T02:47:39.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.411+0000 7f34dc800640 1 -- 172.21.15.149:0/2455533287 wait complete. 2024-08-17T02:47:39.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.412+0000 7f34dc800640 1 Processor -- start 2024-08-17T02:47:39.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.412+0000 7f34dc800640 1 -- start start 2024-08-17T02:47:39.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34dc800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34d40c7db0 0x7f34d40adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34dc800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 0x7f34d4150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34dc800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d4155e50 0x7f34d40c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34dc800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40ae4a0 con 0x7f34d4155a80 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34dc800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40ac4f0 con 0x7f34d4155e50 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34dc800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40ac7d0 con 0x7f34d40c7db0 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34d9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 0x7f34d4150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34d9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 0x7f34d4150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56308/0 (socket says 172.21.15.149:56308) 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.413+0000 7f34d9400640 1 -- 172.21.15.149:0/2470001683 learned_addr learned my addr 172.21.15.149:0/2470001683 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34d9400640 1 -- 172.21.15.149:0/2470001683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34d40c7db0 msgr2=0x7f34d40adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34d9400640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34d40c7db0 0x7f34d40adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34d9400640 1 -- 172.21.15.149:0/2470001683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d4155e50 msgr2=0x7f34d40c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34d9400640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d4155e50 0x7f34d40c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34d9400640 1 -- 172.21.15.149:0/2470001683 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4009390 con 0x7f34d4155a80 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34d9400640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 0x7f34d4150340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009360 tx=0x7f34c4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4031bb0 con 0x7f34d4155a80 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c4031d10 con 0x7f34d4155a80 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c403d670 con 0x7f34d4155a80 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40acab0 con 0x7f34d4155a80 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.414+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d4157d10 con 0x7f34d4155a80 2024-08-17T02:47:39.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.415+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4071050 con 0x7f34d4155a80 2024-08-17T02:47:39.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.416+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f34c4039040 con 0x7f34d4155a80 2024-08-17T02:47:39.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.417+0000 7f34cd600640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f34b8065150 0x7f34b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.418+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34c40a22a0 con 0x7f34d4155a80 2024-08-17T02:47:39.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.418+0000 7f34d9e00640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f34b8065150 0x7f34b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.418+0000 7f34d9e00640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f34b8065150 0x7f34b8067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005840 tx=0x7f34c8007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.422+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f34c40702c0 con 0x7f34d4155a80 2024-08-17T02:47:39.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:39.635+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f34d4168f90 con 0x7f34d4155a80 2024-08-17T02:47:39.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:39.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:40.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.522+0000 7f34cd600640 1 -- 172.21.15.149:0/2470001683 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34d4168f90 con 0x7f34d4155a80 2024-08-17T02:47:40.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f34b8065150 msgr2=0x7f34b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f34b8065150 0x7f34b8067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005840 tx=0x7f34c8007960 comp rx=0 tx=0).stop 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 msgr2=0x7f34d4150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 0x7f34d4150340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009360 tx=0x7f34c4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 shutdown_connections 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f34b8065150 0x7f34b8067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34d4155e50 0x7f34d40c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d4155a80 0x7f34d4150340 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 --2- 172.21.15.149:0/2470001683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34d40c7db0 0x7f34d40adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 >> 172.21.15.149:0/2470001683 conn(0x7f34d4067750 msgr2=0x7f34d40ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:40.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 shutdown_connections 2024-08-17T02:47:40.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.525+0000 7f34dc800640 1 -- 172.21.15.149:0/2470001683 wait complete. 2024-08-17T02:47:40.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:47:40.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.701+0000 7f1cc7c00640 1 Processor -- start 2024-08-17T02:47:40.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.701+0000 7f1cc7c00640 1 -- start start 2024-08-17T02:47:40.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc7c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc0156c50 0x7f1cc00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc7c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1cc00adcf0 0x7f1cc00ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc7c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1cc00abb00 0x7f1cc00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc7c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00ab130 con 0x7f1cc00adcf0 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc7c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00ae5a0 con 0x7f1cc00abb00 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc7c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00ae2c0 con 0x7f1cc0156c50 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cbfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1cc00adcf0 0x7f1cc00ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cbfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1cc00adcf0 0x7f1cc00ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56320/0 (socket says 172.21.15.149:56320) 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cbfe00640 1 -- 172.21.15.149:0/2661618682 learned_addr learned my addr 172.21.15.149:0/2661618682 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc5200640 1 --2- 172.21.15.149:0/2661618682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc0156c50 0x7f1cc00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.702+0000 7f1cc5c00640 1 --2- 172.21.15.149:0/2661618682 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00abb00 0x7f1cc00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.703+0000 7f1cbfe00640 1 -- 172.21.15.149:0/2661618682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc0156c50 msgr2=0x7f1cc00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.703+0000 7f1cbfe00640 1 --2- 172.21.15.149:0/2661618682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc0156c50 0x7f1cc00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.703+0000 7f1cbfe00640 1 -- 172.21.15.149:0/2661618682 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00abb00 msgr2=0x7f1cc00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:40.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.703+0000 7f1cbfe00640 1 --2- 172.21.15.149:0/2661618682 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00abb00 0x7f1cc00c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.703+0000 7f1cbfe00640 1 -- 172.21.15.149:0/2661618682 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00aaae0 con 0x7f1cc00adcf0 2024-08-17T02:47:40.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.703+0000 7f1cc5c00640 1 --2- 172.21.15.149:0/2661618682 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00abb00 0x7f1cc00c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cbfe00640 1 --2- 172.21.15.149:0/2661618682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00adcf0 0x7f1cc00ab5c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006ef40 tx=0x7f1cac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7badc708ad16eab6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cbf400640 1 -- 172.21.15.149:0/2661618682 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac02ad40 con 0x7f1cc00adcf0 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cbf400640 1 -- 172.21.15.149:0/2661618682 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac032440 con 0x7f1cc00adcf0 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cbf400640 1 -- 172.21.15.149:0/2661618682 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac02aea0 con 0x7f1cc00adcf0 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cc7c00640 1 -- 172.21.15.149:0/2661618682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00adcf0 msgr2=0x7f1cc00ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/2661618682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00adcf0 0x7f1cc00ab5c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006ef40 tx=0x7f1cac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cc7c00640 1 -- 172.21.15.149:0/2661618682 shutdown_connections 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/2661618682 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00abb00 0x7f1cc00c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.704+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/2661618682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00adcf0 0x7f1cc00ab5c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.705+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/2661618682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc0156c50 0x7f1cc00c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.705+0000 7f1cc7c00640 1 -- 172.21.15.149:0/2661618682 >> 172.21.15.149:0/2661618682 conn(0x7f1cc0067750 msgr2=0x7f1cc00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:40.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.705+0000 7f1cc7c00640 1 -- 172.21.15.149:0/2661618682 shutdown_connections 2024-08-17T02:47:40.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.705+0000 7f1cc7c00640 1 -- 172.21.15.149:0/2661618682 wait complete. 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.706+0000 7f1cc7c00640 1 Processor -- start 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.706+0000 7f1cc7c00640 1 -- start start 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc7c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00abb00 0x7f1cc0148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc7c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00adcf0 0x7f1cc006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc7c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 0x7f1cc006d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc7c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc01564b0 con 0x7f1cc0156c50 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc7c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0149920 con 0x7f1cc00abb00 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc7c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc01548c0 con 0x7f1cc00adcf0 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 0x7f1cc006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 0x7f1cc006d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56328/0 (socket says 172.21.15.149:56328) 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc5c00640 1 -- 172.21.15.149:0/3234354588 learned_addr learned my addr 172.21.15.149:0/3234354588 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cbfe00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00adcf0 0x7f1cc006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.707+0000 7f1cc5200640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00abb00 0x7f1cc0148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc5c00640 1 -- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00adcf0 msgr2=0x7f1cc006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc5c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00adcf0 0x7f1cc006ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc5c00640 1 -- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00abb00 msgr2=0x7f1cc0148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc5c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00abb00 0x7f1cc0148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc5c00640 1 -- 172.21.15.149:0/3234354588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac009450 con 0x7f1cc0156c50 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc5c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 0x7f1cc006d200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d180 tx=0x7f1cb8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800dea0 con 0x7f1cc0156c50 2024-08-17T02:47:40.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800f040 con 0x7f1cc0156c50 2024-08-17T02:47:40.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8015650 con 0x7f1cc0156c50 2024-08-17T02:47:40.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc0169c70 con 0x7f1cc0156c50 2024-08-17T02:47:40.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.708+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0154550 con 0x7f1cc0156c50 2024-08-17T02:47:40.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.709+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc01540d0 con 0x7f1cc0156c50 2024-08-17T02:47:40.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.710+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1cb8015a40 con 0x7f1cc0156c50 2024-08-17T02:47:40.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.711+0000 7f1cb3e00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ca0065180 0x7f1ca0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.711+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cb8082c10 con 0x7f1cc0156c50 2024-08-17T02:47:40.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.712+0000 7f1cc5200640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ca0065180 0x7f1ca0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.712+0000 7f1cc5200640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ca0065180 0x7f1ca0067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00ace10 tx=0x7f1cb40090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:40.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.715+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1cc01540d0 con 0x7f1cc0156c50 2024-08-17T02:47:40.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:40.926+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1cc01540d0 con 0x7f1cc0156c50 2024-08-17T02:47:41.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.524+0000 7f1cb3e00640 1 -- 172.21.15.149:0/3234354588 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cc01540d0 con 0x7f1cc0156c50 2024-08-17T02:47:41.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ca0065180 msgr2=0x7f1ca0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ca0065180 0x7f1ca0067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00ace10 tx=0x7f1cb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 msgr2=0x7f1cc006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 0x7f1cc006d200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d180 tx=0x7f1cb8009a50 comp rx=0 tx=0).stop 2024-08-17T02:47:41.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 shutdown_connections 2024-08-17T02:47:41.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1ca0065180 0x7f1ca0067630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc0156c50 0x7f1cc006d200 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00adcf0 0x7f1cc006ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 --2- 172.21.15.149:0/3234354588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00abb00 0x7f1cc0148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 >> 172.21.15.149:0/3234354588 conn(0x7f1cc0067750 msgr2=0x7f1cc00af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:41.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 shutdown_connections 2024-08-17T02:47:41.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.526+0000 7f1cc7c00640 1 -- 172.21.15.149:0/3234354588 wait complete. 2024-08-17T02:47:41.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:41.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.696+0000 7fb0b9e00640 1 Processor -- start 2024-08-17T02:47:41.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.697+0000 7fb0b9e00640 1 -- start start 2024-08-17T02:47:41.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b9e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb0b4155a20 0x7fb0b40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b9e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b9e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0b406d7f0 0x7fb0b406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b9e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40b0350 con 0x7fb0b4155a20 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b9e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b406e1d0 con 0x7fb0b406d7f0 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b9e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4156670 con 0x7fb0b4155df0 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb0b4155a20 0x7fb0b40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb0b4155a20 0x7fb0b40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56330/0 (socket says 172.21.15.149:56330) 2024-08-17T02:47:41.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b2a00640 1 -- 172.21.15.149:0/2162303905 learned_addr learned my addr 172.21.15.149:0/2162303905 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:41.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0b3400640 1 --2- 172.21.15.149:0/2162303905 >> v2:172.21.15.161:3300/0 conn(0x7fb0b406d7f0 0x7fb0b406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.698+0000 7fb0aa000640 1 --2- 172.21.15.149:0/2162303905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.699+0000 7fb0b2a00640 1 -- 172.21.15.149:0/2162303905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 msgr2=0x7fb0b40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:41.701 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.699+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2162303905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.699+0000 7fb0b2a00640 1 -- 172.21.15.149:0/2162303905 >> v2:172.21.15.161:3300/0 conn(0x7fb0b406d7f0 msgr2=0x7fb0b406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.699+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2162303905 >> v2:172.21.15.161:3300/0 conn(0x7fb0b406d7f0 0x7fb0b406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.699+0000 7fb0b2a00640 1 -- 172.21.15.149:0/2162303905 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b406e5e0 con 0x7fb0b4155a20 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2162303905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40adf10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0b41565e0 tx=0x7fb0a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e9d2057011dd0c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b2000640 1 -- 172.21.15.149:0/2162303905 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a402add0 con 0x7fb0b4155a20 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b2000640 1 -- 172.21.15.149:0/2162303905 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4032440 con 0x7fb0b4155a20 2024-08-17T02:47:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b2000640 1 -- 172.21.15.149:0/2162303905 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4032820 con 0x7fb0b4155a20 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2162303905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 msgr2=0x7fb0b40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2162303905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40adf10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0b41565e0 tx=0x7fb0a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2162303905 shutdown_connections 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2162303905 >> v2:172.21.15.161:3300/0 conn(0x7fb0b406d7f0 0x7fb0b406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2162303905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.700+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2162303905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40adf10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.701+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2162303905 >> 172.21.15.149:0/2162303905 conn(0x7fb0b40cb9b0 msgr2=0x7fb0b40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.701+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2162303905 shutdown_connections 2024-08-17T02:47:41.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.701+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2162303905 wait complete. 2024-08-17T02:47:41.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.702+0000 7fb0b9e00640 1 Processor -- start 2024-08-17T02:47:41.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.702+0000 7fb0b9e00640 1 -- start start 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b9e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b406d7f0 0x7fb0b40caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b9e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b41690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b9e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40687b0 con 0x7fb0b4155a20 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b9e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4069330 con 0x7fb0b406d7f0 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b9e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4068a00 con 0x7fb0b4155df0 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0aa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0aa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40aa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56340/0 (socket says 172.21.15.149:56340) 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0aa000640 1 -- 172.21.15.149:0/2812973533 learned_addr learned my addr 172.21.15.149:0/2812973533 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b406d7f0 0x7fb0b40caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.703+0000 7fb0b3400640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b41690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aa000640 1 -- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 msgr2=0x7fb0b41690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aa000640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b41690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aa000640 1 -- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b406d7f0 msgr2=0x7fb0b40caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aa000640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b406d7f0 0x7fb0b40caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aa000640 1 -- 172.21.15.149:0/2812973533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4009450 con 0x7fb0b4155a20 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b406d7f0 0x7fb0b40caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aa000640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40aa750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00d890 tx=0x7fb09c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00de20 con 0x7fb0b4155a20 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0098b0 con 0x7fb0b4155a20 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c009c50 con 0x7fb0b4155a20 2024-08-17T02:47:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.704+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4068ce0 con 0x7fb0b4155a20 2024-08-17T02:47:41.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.705+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b4154170 con 0x7fb0b4155a20 2024-08-17T02:47:41.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.705+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b40694a0 con 0x7fb0b4155a20 2024-08-17T02:47:41.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.706+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb09c014620 con 0x7fb0b4155a20 2024-08-17T02:47:41.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.707+0000 7fb0aaa00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb090065150 0x7fb090067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.707+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb09c082bb0 con 0x7fb0b4155a20 2024-08-17T02:47:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.707+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb090065150 0x7fb090067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.708+0000 7fb0b2a00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb090065150 0x7fb090067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4034000 tx=0x7fb0a4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:41.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.711+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb09c050c80 con 0x7fb0b4155a20 2024-08-17T02:47:41.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.919+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0b4064db0 con 0x7fb0b4155a20 2024-08-17T02:47:41.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.920+0000 7fb0aaa00640 1 -- 172.21.15.149:0/2812973533 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fb09c0542a0 con 0x7fb0b4155a20 2024-08-17T02:47:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:41.922 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:37.896789+0000","modified":"2024-08-17T02:47:41.522751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4870":{"gid":4870,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/807513628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":807513628},{"type":"v1","addr":"172.21.15.161:6835","nonce":807513628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:47:41.922 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb090065150 msgr2=0x7fb090067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb090065150 0x7fb090067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4034000 tx=0x7fb0a4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 msgr2=0x7fb0b40aa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40aa750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00d890 tx=0x7fb09c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 shutdown_connections 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb090065150 0x7fb090067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b4155df0 0x7fb0b41690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b4155a20 0x7fb0b40aa750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 --2- 172.21.15.149:0/2812973533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b406d7f0 0x7fb0b40caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 >> 172.21.15.149:0/2812973533 conn(0x7fb0b40cb9b0 msgr2=0x7fb0b4154890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.922+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 shutdown_connections 2024-08-17T02:47:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:41.923+0000 7fb0b9e00640 1 -- 172.21.15.149:0/2812973533 wait complete. 2024-08-17T02:47:41.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:42.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.087+0000 7f7f9ce00640 1 Processor -- start 2024-08-17T02:47:42.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.087+0000 7f7f9ce00640 1 -- start start 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.088+0000 7f7f9ce00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7f98158cf0 0x7f7f9815a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.088+0000 7f7f9ce00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7f98159bd0 0x7f7f980cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.088+0000 7f7f9ce00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9815a590 con 0x7f7f981590c0 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.088+0000 7f7f9ce00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980cbd90 con 0x7f7f98159bd0 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.088+0000 7f7f9ce00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980cb4d0 con 0x7f7f98158cf0 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.088+0000 7f7f97e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7f98159bd0 0x7f7f980cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7f98159bd0 0x7f7f980cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56352/0 (socket says 172.21.15.149:56352) 2024-08-17T02:47:42.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7f98158cf0 0x7f7f9815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97e00640 1 -- 172.21.15.149:0/1565968336 learned_addr learned my addr 172.21.15.149:0/1565968336 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:42.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97e00640 1 -- 172.21.15.149:0/1565968336 >> v2:172.21.15.161:3300/0 conn(0x7f7f98158cf0 msgr2=0x7f7f9815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97e00640 1 --2- 172.21.15.149:0/1565968336 >> v2:172.21.15.161:3300/0 conn(0x7f7f98158cf0 0x7f7f9815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97e00640 1 -- 172.21.15.149:0/1565968336 >> v1:172.21.15.161:6789/0 conn(0x7f7f981590c0 legacy=0x7f7f981594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97e00640 1 -- 172.21.15.149:0/1565968336 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980cb740 con 0x7f7f98159bd0 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.089+0000 7f7f97400640 1 --2- 172.21.15.149:0/1565968336 >> v2:172.21.15.161:3300/0 conn(0x7f7f98158cf0 0x7f7f9815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.090+0000 7f7f97e00640 1 --2- 172.21.15.149:0/1565968336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98159bd0 0x7f7f980cd750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7f9805eaf0 tx=0x7f7f90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fad9cfe3f91ebe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.090+0000 7f7f96a00640 1 -- 172.21.15.149:0/1565968336 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9002e050 con 0x7f7f98159bd0 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.090+0000 7f7f96a00640 1 -- 172.21.15.149:0/1565968336 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90007400 con 0x7f7f98159bd0 2024-08-17T02:47:42.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.090+0000 7f7f96a00640 1 -- 172.21.15.149:0/1565968336 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900077e0 con 0x7f7f98159bd0 2024-08-17T02:47:42.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 -- 172.21.15.149:0/1565968336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98159bd0 msgr2=0x7f7f980cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/1565968336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98159bd0 0x7f7f980cd750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7f9805eaf0 tx=0x7f7f90009840 comp rx=0 tx=0).stop 2024-08-17T02:47:42.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 -- 172.21.15.149:0/1565968336 shutdown_connections 2024-08-17T02:47:42.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/1565968336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98159bd0 0x7f7f980cd750 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/1565968336 >> v2:172.21.15.161:3300/0 conn(0x7f7f98158cf0 0x7f7f9815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 -- 172.21.15.149:0/1565968336 >> 172.21.15.149:0/1565968336 conn(0x7f7f9806eb90 msgr2=0x7f7f980cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 -- 172.21.15.149:0/1565968336 shutdown_connections 2024-08-17T02:47:42.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.091+0000 7f7f9ce00640 1 -- 172.21.15.149:0/1565968336 wait complete. 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.092+0000 7f7f9ce00640 1 Processor -- start 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.092+0000 7f7f9ce00640 1 -- start start 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.093+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 0x7f7f980b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.093+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f981590c0 0x7f7f9809c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.093+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f98159bd0 0x7f7f981441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.093+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c7fa0 con 0x7f7f98158cf0 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.093+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9809cde0 con 0x7f7f98159bd0 2024-08-17T02:47:42.095 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.093+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9809d0c0 con 0x7f7f981590c0 2024-08-17T02:47:42.096 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 0x7f7f980b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 0x7f7f980b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56366/0 (socket says 172.21.15.149:56366) 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 -- 172.21.15.149:0/105330114 learned_addr learned my addr 172.21.15.149:0/105330114 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f8fe00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f981590c0 0x7f7f9809c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97e00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f98159bd0 0x7f7f981441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 -- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f981590c0 msgr2=0x7f7f9809c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f981590c0 0x7f7f9809c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 -- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f98159bd0 msgr2=0x7f7f981441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f98159bd0 0x7f7f981441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 -- 172.21.15.149:0/105330114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88009390 con 0x7f7f98158cf0 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97e00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f98159bd0 0x7f7f981441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f8fe00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f981590c0 0x7f7f9809c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f97400640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 0x7f7f980b4030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800ec80 tx=0x7f7f880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800eec0 con 0x7f7f98158cf0 2024-08-17T02:47:42.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800cbc0 con 0x7f7f98158cf0 2024-08-17T02:47:42.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.094+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88013470 con 0x7f7f98158cf0 2024-08-17T02:47:42.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.095+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90009ae0 con 0x7f7f98158cf0 2024-08-17T02:47:42.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.095+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9809d680 con 0x7f7f98158cf0 2024-08-17T02:47:42.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.096+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f98071050 con 0x7f7f98158cf0 2024-08-17T02:47:42.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.096+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7f880137e0 con 0x7f7f98158cf0 2024-08-17T02:47:42.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.097+0000 7f7f8ea00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7f74065150 0x7f7f74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.097+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f880828f0 con 0x7f7f98158cf0 2024-08-17T02:47:42.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.098+0000 7f7f8fe00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7f74065150 0x7f7f74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.098+0000 7f7f8fe00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7f74065150 0x7f7f74067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f9816c350 tx=0x7f7f80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.101+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7f88050910 con 0x7f7f98158cf0 2024-08-17T02:47:42.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.275+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f980b5950 con 0x7f7f98158cf0 2024-08-17T02:47:42.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.275+0000 7f7f8ea00640 1 -- 172.21.15.149:0/105330114 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7f88021090 con 0x7f7f98158cf0 2024-08-17T02:47:42.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:42.277 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":34,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:39.497858+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7f74065150 msgr2=0x7f7f74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7f74065150 0x7f7f74067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f9816c350 tx=0x7f7f80009040 comp rx=0 tx=0).stop 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 msgr2=0x7f7f980b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 0x7f7f980b4030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800ec80 tx=0x7f7f880090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 shutdown_connections 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7f74065150 0x7f7f74067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f98159bd0 0x7f7f981441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f981590c0 0x7f7f9809c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 --2- 172.21.15.149:0/105330114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f98158cf0 0x7f7f980b4030 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 >> 172.21.15.149:0/105330114 conn(0x7f7f9806eb90 msgr2=0x7f7f980cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 shutdown_connections 2024-08-17T02:47:42.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.278+0000 7f7f9ce00640 1 -- 172.21.15.149:0/105330114 wait complete. 2024-08-17T02:47:42.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:47:42.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:42.344 INFO:tasks.ceph.mds.d.smithi161.stderr:2024-08-17T02:47:42.343+0000 7f3d26800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:42.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.443+0000 7eff9ba00640 1 Processor -- start 2024-08-17T02:47:42.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.443+0000 7eff9ba00640 1 -- start start 2024-08-17T02:47:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff9ba00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff94155180 0x7eff940aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff9ba00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 0x7eff940ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff9ba00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940afc10 con 0x7eff9406e080 2024-08-17T02:47:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff9ba00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940ae5b0 con 0x7eff94155180 2024-08-17T02:47:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff9ba00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940af000 con 0x7eff94155550 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 0x7eff940ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff99000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff94155180 0x7eff940aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 0x7eff940ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:52506/0 (socket says 172.21.15.149:52506) 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 -- 172.21.15.149:0/4017923927 learned_addr learned my addr 172.21.15.149:0/4017923927 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 -- 172.21.15.149:0/4017923927 >> v2:172.21.15.161:3300/0 conn(0x7eff94155180 msgr2=0x7eff940aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 --2- 172.21.15.149:0/4017923927 >> v2:172.21.15.161:3300/0 conn(0x7eff94155180 0x7eff940aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 -- 172.21.15.149:0/4017923927 >> v1:172.21.15.161:6789/0 conn(0x7eff9406e080 legacy=0x7eff9406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.445+0000 7eff8be00640 1 -- 172.21.15.149:0/4017923927 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940af2e0 con 0x7eff94155550 2024-08-17T02:47:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff8be00640 1 --2- 172.21.15.149:0/4017923927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 0x7eff940ae070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009910 tx=0x7eff7c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cefd748287e5da08 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff93e00640 1 -- 172.21.15.149:0/4017923927 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c02ae40 con 0x7eff94155550 2024-08-17T02:47:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff93e00640 1 -- 172.21.15.149:0/4017923927 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c032440 con 0x7eff94155550 2024-08-17T02:47:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff93e00640 1 -- 172.21.15.149:0/4017923927 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c032820 con 0x7eff94155550 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff9ba00640 1 -- 172.21.15.149:0/4017923927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 msgr2=0x7eff940ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff9ba00640 1 --2- 172.21.15.149:0/4017923927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 0x7eff940ae070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009910 tx=0x7eff7c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff9ba00640 1 -- 172.21.15.149:0/4017923927 shutdown_connections 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff9ba00640 1 --2- 172.21.15.149:0/4017923927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff94155550 0x7eff940ae070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff9ba00640 1 --2- 172.21.15.149:0/4017923927 >> v2:172.21.15.161:3300/0 conn(0x7eff94155180 0x7eff940aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.447+0000 7eff9ba00640 1 -- 172.21.15.149:0/4017923927 >> 172.21.15.149:0/4017923927 conn(0x7eff940cb9b0 msgr2=0x7eff940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.448+0000 7eff9ba00640 1 -- 172.21.15.149:0/4017923927 shutdown_connections 2024-08-17T02:47:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.448+0000 7eff9ba00640 1 -- 172.21.15.149:0/4017923927 wait complete. 2024-08-17T02:47:42.451 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.449+0000 7eff9ba00640 1 Processor -- start 2024-08-17T02:47:42.451 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.449+0000 7eff9ba00640 1 -- start start 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff9ba00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff9406e080 0x7eff94169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff9ba00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155180 0x7eff940c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff9ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 0x7eff94158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff9ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9416a870 con 0x7eff94155550 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff9ba00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c1240 con 0x7eff94155180 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff9ba00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9416a240 con 0x7eff9406e080 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff99a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 0x7eff94158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff99a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 0x7eff94158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56374/0 (socket says 172.21.15.149:56374) 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff8be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155180 0x7eff940c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff99000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff9406e080 0x7eff94169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.450+0000 7eff99a00640 1 -- 172.21.15.149:0/845135490 learned_addr learned my addr 172.21.15.149:0/845135490 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:42.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff99a00640 1 -- 172.21.15.149:0/845135490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff9406e080 msgr2=0x7eff94169910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff99a00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff9406e080 0x7eff94169910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff99a00640 1 -- 172.21.15.149:0/845135490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155180 msgr2=0x7eff940c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff99a00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155180 0x7eff940c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff99a00640 1 -- 172.21.15.149:0/845135490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c009450 con 0x7eff94155550 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff99a00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 0x7eff94158240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c860 tx=0x7eff8c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00ce50 con 0x7eff94155550 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00a850 con 0x7eff94155550 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940c0f60 con 0x7eff94155550 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00ac10 con 0x7eff94155550 2024-08-17T02:47:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.451+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff94169e50 con 0x7eff94155550 2024-08-17T02:47:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.453+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9416a9e0 con 0x7eff94155550 2024-08-17T02:47:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.453+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7eff8c012420 con 0x7eff94155550 2024-08-17T02:47:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.454+0000 7eff90c00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7eff70065180 0x7eff70067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.455+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff8c0825d0 con 0x7eff94155550 2024-08-17T02:47:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.455+0000 7eff99000640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7eff70065180 0x7eff70067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.455+0000 7eff99000640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7eff70065180 0x7eff70067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff94153860 tx=0x7eff840090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.459+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7eff8c050740 con 0x7eff94155550 2024-08-17T02:47:42.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.630+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff94064db0 con 0x7eff70065180 2024-08-17T02:47:42.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.639+0000 7eff90c00640 1 -- 172.21.15.149:0/845135490 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288717 (secure 0 0 0) 0x7eff94064db0 con 0x7eff70065180 2024-08-17T02:47:42.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:42.646 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:47:42.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7eff70065180 msgr2=0x7eff70067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7eff70065180 0x7eff70067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff94153860 tx=0x7eff840090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 msgr2=0x7eff94158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 0x7eff94158240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c860 tx=0x7eff8c001690 comp rx=0 tx=0).stop 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 shutdown_connections 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7eff70065180 0x7eff70067630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff94155550 0x7eff94158240 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155180 0x7eff940c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 --2- 172.21.15.149:0/845135490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff9406e080 0x7eff94169910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.643+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 >> 172.21.15.149:0/845135490 conn(0x7eff940cb9b0 msgr2=0x7eff940c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.644+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 shutdown_connections 2024-08-17T02:47:42.649 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.644+0000 7eff9ba00640 1 -- 172.21.15.149:0/845135490 wait complete. 2024-08-17T02:47:42.660 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-08-17T02:47:41.635858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382992,"kb_used_data":4108,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591728,"statfs":{"total":773094113280,"available":770653929472,"internally_reserved":0,"allocated":4206592,"data_stored":2321676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.160006"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.526063+0000","last_change":"2024-08-17T02:47:38.526063+0000","last_active":"2024-08-17T02:47:38.526063+0000","last_peered":"2024-08-17T02:47:38.526063+0000","last_clean":"2024-08-17T02:47:38.526063+0000","last_became_active":"2024-08-17T02:47:38.525823+0000","last_became_peered":"2024-08-17T02:47:38.525823+0000","last_unstale":"2024-08-17T02:47:38.526063+0000","last_undegraded":"2024-08-17T02:47:38.526063+0000","last_fullsized":"2024-08-17T02:47:38.526063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:04:28.096254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516821+0000","last_change":"2024-08-17T02:47:38.509459+0000","last_active":"2024-08-17T02:47:38.516821+0000","last_peered":"2024-08-17T02:47:38.516821+0000","last_clean":"2024-08-17T02:47:38.516821+0000","last_became_active":"2024-08-17T02:47:38.509218+0000","last_became_peered":"2024-08-17T02:47:38.509218+0000","last_unstale":"2024-08-17T02:47:38.516821+0000","last_undegraded":"2024-08-17T02:47:38.516821+0000","last_fullsized":"2024-08-17T02:47:38.516821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:32.253080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515735+0000","last_change":"2024-08-17T02:47:38.509568+0000","last_active":"2024-08-17T02:47:38.515735+0000","last_peered":"2024-08-17T02:47:38.515735+0000","last_clean":"2024-08-17T02:47:38.515735+0000","last_became_active":"2024-08-17T02:47:38.509192+0000","last_became_peered":"2024-08-17T02:47:38.509192+0000","last_unstale":"2024-08-17T02:47:38.515735+0000","last_undegraded":"2024-08-17T02:47:38.515735+0000","last_fullsized":"2024-08-17T02:47:38.515735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:51.644235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519894+0000","last_change":"2024-08-17T02:47:38.518219+0000","last_active":"2024-08-17T02:47:38.519894+0000","last_peered":"2024-08-17T02:47:38.519894+0000","last_clean":"2024-08-17T02:47:38.519894+0000","last_became_active":"2024-08-17T02:47:38.517832+0000","last_became_peered":"2024-08-17T02:47:38.517832+0000","last_unstale":"2024-08-17T02:47:38.519894+0000","last_undegraded":"2024-08-17T02:47:38.519894+0000","last_fullsized":"2024-08-17T02:47:38.519894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:10.626577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517075+0000","last_change":"2024-08-17T02:47:38.511559+0000","last_active":"2024-08-17T02:47:38.517075+0000","last_peered":"2024-08-17T02:47:38.517075+0000","last_clean":"2024-08-17T02:47:38.517075+0000","last_became_active":"2024-08-17T02:47:38.511334+0000","last_became_peered":"2024-08-17T02:47:38.511334+0000","last_unstale":"2024-08-17T02:47:38.517075+0000","last_undegraded":"2024-08-17T02:47:38.517075+0000","last_fullsized":"2024-08-17T02:47:38.517075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:29.457883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518290+0000","last_change":"2024-08-17T02:47:38.516843+0000","last_active":"2024-08-17T02:47:38.518290+0000","last_peered":"2024-08-17T02:47:38.518290+0000","last_clean":"2024-08-17T02:47:38.518290+0000","last_became_active":"2024-08-17T02:47:38.516448+0000","last_became_peered":"2024-08-17T02:47:38.516448+0000","last_unstale":"2024-08-17T02:47:38.518290+0000","last_undegraded":"2024-08-17T02:47:38.518290+0000","last_fullsized":"2024-08-17T02:47:38.518290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:03.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.525082+0000","last_change":"2024-08-17T02:47:38.525082+0000","last_active":"2024-08-17T02:47:38.525082+0000","last_peered":"2024-08-17T02:47:38.525082+0000","last_clean":"2024-08-17T02:47:38.525082+0000","last_became_active":"2024-08-17T02:47:38.524824+0000","last_became_peered":"2024-08-17T02:47:38.524824+0000","last_unstale":"2024-08-17T02:47:38.525082+0000","last_undegraded":"2024-08-17T02:47:38.525082+0000","last_fullsized":"2024-08-17T02:47:38.525082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:08.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514400+0000","last_change":"2024-08-17T02:47:38.514400+0000","last_active":"2024-08-17T02:47:38.514400+0000","last_peered":"2024-08-17T02:47:38.514400+0000","last_clean":"2024-08-17T02:47:38.514400+0000","last_became_active":"2024-08-17T02:47:38.510800+0000","last_became_peered":"2024-08-17T02:47:38.510800+0000","last_unstale":"2024-08-17T02:47:38.514400+0000","last_undegraded":"2024-08-17T02:47:38.514400+0000","last_fullsized":"2024-08-17T02:47:38.514400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:24.329977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513974+0000","last_change":"2024-08-17T02:47:38.513974+0000","last_active":"2024-08-17T02:47:38.513974+0000","last_peered":"2024-08-17T02:47:38.513974+0000","last_clean":"2024-08-17T02:47:38.513974+0000","last_became_active":"2024-08-17T02:47:38.513475+0000","last_became_peered":"2024-08-17T02:47:38.513475+0000","last_unstale":"2024-08-17T02:47:38.513974+0000","last_undegraded":"2024-08-17T02:47:38.513974+0000","last_fullsized":"2024-08-17T02:47:38.513974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:48.509277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.527382+0000","last_change":"2024-08-17T02:47:38.525833+0000","last_active":"2024-08-17T02:47:38.527382+0000","last_peered":"2024-08-17T02:47:38.527382+0000","last_clean":"2024-08-17T02:47:38.527382+0000","last_became_active":"2024-08-17T02:47:38.523099+0000","last_became_peered":"2024-08-17T02:47:38.523099+0000","last_unstale":"2024-08-17T02:47:38.527382+0000","last_undegraded":"2024-08-17T02:47:38.527382+0000","last_fullsized":"2024-08-17T02:47:38.527382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:03.879723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.512733+0000","last_change":"2024-08-17T02:47:38.512733+0000","last_active":"2024-08-17T02:47:38.512733+0000","last_peered":"2024-08-17T02:47:38.512733+0000","last_clean":"2024-08-17T02:47:38.512733+0000","last_became_active":"2024-08-17T02:47:38.512493+0000","last_became_peered":"2024-08-17T02:47:38.512493+0000","last_unstale":"2024-08-17T02:47:38.512733+0000","last_undegraded":"2024-08-17T02:47:38.512733+0000","last_fullsized":"2024-08-17T02:47:38.512733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:55:51.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514241+0000","last_change":"2024-08-17T02:47:38.508242+0000","last_active":"2024-08-17T02:47:38.514241+0000","last_peered":"2024-08-17T02:47:38.514241+0000","last_clean":"2024-08-17T02:47:38.514241+0000","last_became_active":"2024-08-17T02:47:38.507977+0000","last_became_peered":"2024-08-17T02:47:38.507977+0000","last_unstale":"2024-08-17T02:47:38.514241+0000","last_undegraded":"2024-08-17T02:47:38.514241+0000","last_fullsized":"2024-08-17T02:47:38.514241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:51.018802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.504982+0000","last_change":"2024-08-17T02:47:38.501046+0000","last_active":"2024-08-17T02:47:38.504982+0000","last_peered":"2024-08-17T02:47:38.504982+0000","last_clean":"2024-08-17T02:47:38.504982+0000","last_became_active":"2024-08-17T02:47:38.500766+0000","last_became_peered":"2024-08-17T02:47:38.500766+0000","last_unstale":"2024-08-17T02:47:38.504982+0000","last_undegraded":"2024-08-17T02:47:38.504982+0000","last_fullsized":"2024-08-17T02:47:38.504982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:54.264535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516704+0000","last_change":"2024-08-17T02:47:38.510520+0000","last_active":"2024-08-17T02:47:38.516704+0000","last_peered":"2024-08-17T02:47:38.516704+0000","last_clean":"2024-08-17T02:47:38.516704+0000","last_became_active":"2024-08-17T02:47:38.508346+0000","last_became_peered":"2024-08-17T02:47:38.508346+0000","last_unstale":"2024-08-17T02:47:38.516704+0000","last_undegraded":"2024-08-17T02:47:38.516704+0000","last_fullsized":"2024-08-17T02:47:38.516704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:41.728557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.523122+0000","last_change":"2024-08-17T02:47:38.516625+0000","last_active":"2024-08-17T02:47:38.523122+0000","last_peered":"2024-08-17T02:47:38.523122+0000","last_clean":"2024-08-17T02:47:38.523122+0000","last_became_active":"2024-08-17T02:47:38.516288+0000","last_became_peered":"2024-08-17T02:47:38.516288+0000","last_unstale":"2024-08-17T02:47:38.523122+0000","last_undegraded":"2024-08-17T02:47:38.523122+0000","last_fullsized":"2024-08-17T02:47:38.523122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:33.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521202+0000","last_change":"2024-08-17T02:47:38.521202+0000","last_active":"2024-08-17T02:47:38.521202+0000","last_peered":"2024-08-17T02:47:38.521202+0000","last_clean":"2024-08-17T02:47:38.521202+0000","last_became_active":"2024-08-17T02:47:38.520967+0000","last_became_peered":"2024-08-17T02:47:38.520967+0000","last_unstale":"2024-08-17T02:47:38.521202+0000","last_undegraded":"2024-08-17T02:47:38.521202+0000","last_fullsized":"2024-08-17T02:47:38.521202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:51.644235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522880+0000","last_change":"2024-08-17T02:47:38.522880+0000","last_active":"2024-08-17T02:47:38.522880+0000","last_peered":"2024-08-17T02:47:38.522880+0000","last_clean":"2024-08-17T02:47:38.522880+0000","last_became_active":"2024-08-17T02:47:38.522502+0000","last_became_peered":"2024-08-17T02:47:38.522502+0000","last_unstale":"2024-08-17T02:47:38.522880+0000","last_undegraded":"2024-08-17T02:47:38.522880+0000","last_fullsized":"2024-08-17T02:47:38.522880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516842+0000","last_change":"2024-08-17T02:47:38.511843+0000","last_active":"2024-08-17T02:47:38.516842+0000","last_peered":"2024-08-17T02:47:38.516842+0000","last_clean":"2024-08-17T02:47:38.516842+0000","last_became_active":"2024-08-17T02:47:38.510859+0000","last_became_peered":"2024-08-17T02:47:38.510859+0000","last_unstale":"2024-08-17T02:47:38.516842+0000","last_undegraded":"2024-08-17T02:47:38.516842+0000","last_fullsized":"2024-08-17T02:47:38.516842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.411226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521962+0000","last_change":"2024-08-17T02:47:38.513052+0000","last_active":"2024-08-17T02:47:38.521962+0000","last_peered":"2024-08-17T02:47:38.521962+0000","last_clean":"2024-08-17T02:47:38.521962+0000","last_became_active":"2024-08-17T02:47:38.512781+0000","last_became_peered":"2024-08-17T02:47:38.512781+0000","last_unstale":"2024-08-17T02:47:38.521962+0000","last_undegraded":"2024-08-17T02:47:38.521962+0000","last_fullsized":"2024-08-17T02:47:38.521962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:17.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515967+0000","last_change":"2024-08-17T02:47:38.509184+0000","last_active":"2024-08-17T02:47:38.515967+0000","last_peered":"2024-08-17T02:47:38.515967+0000","last_clean":"2024-08-17T02:47:38.515967+0000","last_became_active":"2024-08-17T02:47:38.508920+0000","last_became_peered":"2024-08-17T02:47:38.508920+0000","last_unstale":"2024-08-17T02:47:38.515967+0000","last_undegraded":"2024-08-17T02:47:38.515967+0000","last_fullsized":"2024-08-17T02:47:38.515967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:33.349142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516821+0000","last_change":"2024-08-17T02:47:38.516821+0000","last_active":"2024-08-17T02:47:38.516821+0000","last_peered":"2024-08-17T02:47:38.516821+0000","last_clean":"2024-08-17T02:47:38.516821+0000","last_became_active":"2024-08-17T02:47:38.516556+0000","last_became_peered":"2024-08-17T02:47:38.516556+0000","last_unstale":"2024-08-17T02:47:38.516821+0000","last_undegraded":"2024-08-17T02:47:38.516821+0000","last_fullsized":"2024-08-17T02:47:38.516821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:28:17.981272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518982+0000","last_change":"2024-08-17T02:47:38.518982+0000","last_active":"2024-08-17T02:47:38.518982+0000","last_peered":"2024-08-17T02:47:38.518982+0000","last_clean":"2024-08-17T02:47:38.518982+0000","last_became_active":"2024-08-17T02:47:38.518659+0000","last_became_peered":"2024-08-17T02:47:38.518659+0000","last_unstale":"2024-08-17T02:47:38.518982+0000","last_undegraded":"2024-08-17T02:47:38.518982+0000","last_fullsized":"2024-08-17T02:47:38.518982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:24.329977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513732+0000","last_change":"2024-08-17T02:47:38.509965+0000","last_active":"2024-08-17T02:47:38.513732+0000","last_peered":"2024-08-17T02:47:38.513732+0000","last_clean":"2024-08-17T02:47:38.513732+0000","last_became_active":"2024-08-17T02:47:38.509712+0000","last_became_peered":"2024-08-17T02:47:38.509712+0000","last_unstale":"2024-08-17T02:47:38.513732+0000","last_undegraded":"2024-08-17T02:47:38.513732+0000","last_fullsized":"2024-08-17T02:47:38.513732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:08.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514048+0000","last_change":"2024-08-17T02:47:38.507047+0000","last_active":"2024-08-17T02:47:38.514048+0000","last_peered":"2024-08-17T02:47:38.514048+0000","last_clean":"2024-08-17T02:47:38.514048+0000","last_became_active":"2024-08-17T02:47:38.506754+0000","last_became_peered":"2024-08-17T02:47:38.506754+0000","last_unstale":"2024-08-17T02:47:38.514048+0000","last_undegraded":"2024-08-17T02:47:38.514048+0000","last_fullsized":"2024-08-17T02:47:38.514048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:08.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.526261+0000","last_change":"2024-08-17T02:47:38.524552+0000","last_active":"2024-08-17T02:47:38.526261+0000","last_peered":"2024-08-17T02:47:38.526261+0000","last_clean":"2024-08-17T02:47:38.526261+0000","last_became_active":"2024-08-17T02:47:38.524301+0000","last_became_peered":"2024-08-17T02:47:38.524301+0000","last_unstale":"2024-08-17T02:47:38.526261+0000","last_undegraded":"2024-08-17T02:47:38.526261+0000","last_fullsized":"2024-08-17T02:47:38.526261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:53.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.529532+0000","last_change":"2024-08-17T02:47:38.527666+0000","last_active":"2024-08-17T02:47:38.529532+0000","last_peered":"2024-08-17T02:47:38.529532+0000","last_clean":"2024-08-17T02:47:38.529532+0000","last_became_active":"2024-08-17T02:47:38.527410+0000","last_became_peered":"2024-08-17T02:47:38.527410+0000","last_unstale":"2024-08-17T02:47:38.529532+0000","last_undegraded":"2024-08-17T02:47:38.529532+0000","last_fullsized":"2024-08-17T02:47:38.529532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:38.435688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519031+0000","last_change":"2024-08-17T02:47:38.515317+0000","last_active":"2024-08-17T02:47:38.519031+0000","last_peered":"2024-08-17T02:47:38.519031+0000","last_clean":"2024-08-17T02:47:38.519031+0000","last_became_active":"2024-08-17T02:47:38.514942+0000","last_became_peered":"2024-08-17T02:47:38.514942+0000","last_unstale":"2024-08-17T02:47:38.519031+0000","last_undegraded":"2024-08-17T02:47:38.519031+0000","last_fullsized":"2024-08-17T02:47:38.519031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:53.322044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514301+0000","last_change":"2024-08-17T02:47:38.508267+0000","last_active":"2024-08-17T02:47:38.514301+0000","last_peered":"2024-08-17T02:47:38.514301+0000","last_clean":"2024-08-17T02:47:38.514301+0000","last_became_active":"2024-08-17T02:47:38.508005+0000","last_became_peered":"2024-08-17T02:47:38.508005+0000","last_unstale":"2024-08-17T02:47:38.514301+0000","last_undegraded":"2024-08-17T02:47:38.514301+0000","last_fullsized":"2024-08-17T02:47:38.514301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:55:51.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521083+0000","last_change":"2024-08-17T02:47:38.521083+0000","last_active":"2024-08-17T02:47:38.521083+0000","last_peered":"2024-08-17T02:47:38.521083+0000","last_clean":"2024-08-17T02:47:38.521083+0000","last_became_active":"2024-08-17T02:47:38.520721+0000","last_became_peered":"2024-08-17T02:47:38.520721+0000","last_unstale":"2024-08-17T02:47:38.521083+0000","last_undegraded":"2024-08-17T02:47:38.521083+0000","last_fullsized":"2024-08-17T02:47:38.521083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:55:51.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517951+0000","last_change":"2024-08-17T02:47:38.517951+0000","last_active":"2024-08-17T02:47:38.517951+0000","last_peered":"2024-08-17T02:47:38.517951+0000","last_clean":"2024-08-17T02:47:38.517951+0000","last_became_active":"2024-08-17T02:47:38.517676+0000","last_became_peered":"2024-08-17T02:47:38.517676+0000","last_unstale":"2024-08-17T02:47:38.517951+0000","last_undegraded":"2024-08-17T02:47:38.517951+0000","last_fullsized":"2024-08-17T02:47:38.517951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:33.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518171+0000","last_change":"2024-08-17T02:47:38.518171+0000","last_active":"2024-08-17T02:47:38.518171+0000","last_peered":"2024-08-17T02:47:38.518171+0000","last_clean":"2024-08-17T02:47:38.518171+0000","last_became_active":"2024-08-17T02:47:38.517925+0000","last_became_peered":"2024-08-17T02:47:38.517925+0000","last_unstale":"2024-08-17T02:47:38.518171+0000","last_undegraded":"2024-08-17T02:47:38.518171+0000","last_fullsized":"2024-08-17T02:47:38.518171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:54.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522329+0000","last_change":"2024-08-17T02:47:38.522329+0000","last_active":"2024-08-17T02:47:38.522329+0000","last_peered":"2024-08-17T02:47:38.522329+0000","last_clean":"2024-08-17T02:47:38.522329+0000","last_became_active":"2024-08-17T02:47:38.521592+0000","last_became_peered":"2024-08-17T02:47:38.521592+0000","last_unstale":"2024-08-17T02:47:38.522329+0000","last_undegraded":"2024-08-17T02:47:38.522329+0000","last_fullsized":"2024-08-17T02:47:38.522329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:51.018802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.523033+0000","last_change":"2024-08-17T02:47:38.520982+0000","last_active":"2024-08-17T02:47:38.523033+0000","last_peered":"2024-08-17T02:47:38.523033+0000","last_clean":"2024-08-17T02:47:38.523033+0000","last_became_active":"2024-08-17T02:47:38.517097+0000","last_became_peered":"2024-08-17T02:47:38.517097+0000","last_unstale":"2024-08-17T02:47:38.523033+0000","last_undegraded":"2024-08-17T02:47:38.523033+0000","last_fullsized":"2024-08-17T02:47:38.523033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:48.509277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.533755+0000","last_change":"2024-08-17T02:47:37.498989+0000","last_active":"2024-08-17T02:47:38.533755+0000","last_peered":"2024-08-17T02:47:38.533755+0000","last_clean":"2024-08-17T02:47:38.533755+0000","last_became_active":"2024-08-17T02:47:37.497440+0000","last_became_peered":"2024-08-17T02:47:37.497440+0000","last_unstale":"2024-08-17T02:47:38.533755+0000","last_undegraded":"2024-08-17T02:47:38.533755+0000","last_fullsized":"2024-08-17T02:47:38.533755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:08.668805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.520894+0000","last_change":"2024-08-17T02:47:38.520894+0000","last_active":"2024-08-17T02:47:38.520894+0000","last_peered":"2024-08-17T02:47:38.520894+0000","last_clean":"2024-08-17T02:47:38.520894+0000","last_became_active":"2024-08-17T02:47:38.520576+0000","last_became_peered":"2024-08-17T02:47:38.520576+0000","last_unstale":"2024-08-17T02:47:38.520894+0000","last_undegraded":"2024-08-17T02:47:38.520894+0000","last_fullsized":"2024-08-17T02:47:38.520894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:15.899589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.530765+0000","last_change":"2024-08-17T02:47:37.499031+0000","last_active":"2024-08-17T02:47:38.530765+0000","last_peered":"2024-08-17T02:47:38.530765+0000","last_clean":"2024-08-17T02:47:38.530765+0000","last_became_active":"2024-08-17T02:47:37.498755+0000","last_became_peered":"2024-08-17T02:47:37.498755+0000","last_unstale":"2024-08-17T02:47:38.530765+0000","last_undegraded":"2024-08-17T02:47:38.530765+0000","last_fullsized":"2024-08-17T02:47:38.530765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:33.759302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517937+0000","last_change":"2024-08-17T02:47:38.517937+0000","last_active":"2024-08-17T02:47:38.517937+0000","last_peered":"2024-08-17T02:47:38.517937+0000","last_clean":"2024-08-17T02:47:38.517937+0000","last_became_active":"2024-08-17T02:47:38.517633+0000","last_became_peered":"2024-08-17T02:47:38.517633+0000","last_unstale":"2024-08-17T02:47:38.517937+0000","last_undegraded":"2024-08-17T02:47:38.517937+0000","last_fullsized":"2024-08-17T02:47:38.517937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.531915+0000","last_change":"2024-08-17T02:47:37.504307+0000","last_active":"2024-08-17T02:47:38.531915+0000","last_peered":"2024-08-17T02:47:38.531915+0000","last_clean":"2024-08-17T02:47:38.531915+0000","last_became_active":"2024-08-17T02:47:37.503822+0000","last_became_peered":"2024-08-17T02:47:37.503822+0000","last_unstale":"2024-08-17T02:47:38.531915+0000","last_undegraded":"2024-08-17T02:47:38.531915+0000","last_fullsized":"2024-08-17T02:47:38.531915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:41:59.428407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518986+0000","last_change":"2024-08-17T02:47:38.515173+0000","last_active":"2024-08-17T02:47:38.518986+0000","last_peered":"2024-08-17T02:47:38.518986+0000","last_clean":"2024-08-17T02:47:38.518986+0000","last_became_active":"2024-08-17T02:47:38.514616+0000","last_became_peered":"2024-08-17T02:47:38.514616+0000","last_unstale":"2024-08-17T02:47:38.518986+0000","last_undegraded":"2024-08-17T02:47:38.518986+0000","last_fullsized":"2024-08-17T02:47:38.518986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:44.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.525998+0000","last_change":"2024-08-17T02:47:37.502211+0000","last_active":"2024-08-17T02:47:38.525998+0000","last_peered":"2024-08-17T02:47:38.525998+0000","last_clean":"2024-08-17T02:47:38.525998+0000","last_became_active":"2024-08-17T02:47:37.501926+0000","last_became_peered":"2024-08-17T02:47:37.501926+0000","last_unstale":"2024-08-17T02:47:38.525998+0000","last_undegraded":"2024-08-17T02:47:38.525998+0000","last_fullsized":"2024-08-17T02:47:38.525998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:17:45.437240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522062+0000","last_change":"2024-08-17T02:47:38.522062+0000","last_active":"2024-08-17T02:47:38.522062+0000","last_peered":"2024-08-17T02:47:38.522062+0000","last_clean":"2024-08-17T02:47:38.522062+0000","last_became_active":"2024-08-17T02:47:38.521713+0000","last_became_peered":"2024-08-17T02:47:38.521713+0000","last_unstale":"2024-08-17T02:47:38.522062+0000","last_undegraded":"2024-08-17T02:47:38.522062+0000","last_fullsized":"2024-08-17T02:47:38.522062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:48.509277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.500583+0000","last_change":"2024-08-17T02:47:37.509581+0000","last_active":"2024-08-17T02:47:38.500583+0000","last_peered":"2024-08-17T02:47:38.500583+0000","last_clean":"2024-08-17T02:47:38.500583+0000","last_became_active":"2024-08-17T02:47:37.508769+0000","last_became_peered":"2024-08-17T02:47:37.508769+0000","last_unstale":"2024-08-17T02:47:38.500583+0000","last_undegraded":"2024-08-17T02:47:38.500583+0000","last_fullsized":"2024-08-17T02:47:38.500583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:19.752313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521912+0000","last_change":"2024-08-17T02:47:38.512388+0000","last_active":"2024-08-17T02:47:38.521912+0000","last_peered":"2024-08-17T02:47:38.521912+0000","last_clean":"2024-08-17T02:47:38.521912+0000","last_became_active":"2024-08-17T02:47:38.512054+0000","last_became_peered":"2024-08-17T02:47:38.512054+0000","last_unstale":"2024-08-17T02:47:38.521912+0000","last_undegraded":"2024-08-17T02:47:38.521912+0000","last_fullsized":"2024-08-17T02:47:38.521912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.501417+0000","last_change":"2024-08-17T02:47:37.509353+0000","last_active":"2024-08-17T02:47:38.501417+0000","last_peered":"2024-08-17T02:47:38.501417+0000","last_clean":"2024-08-17T02:47:38.501417+0000","last_became_active":"2024-08-17T02:47:37.508776+0000","last_became_peered":"2024-08-17T02:47:37.508776+0000","last_unstale":"2024-08-17T02:47:38.501417+0000","last_undegraded":"2024-08-17T02:47:38.501417+0000","last_fullsized":"2024-08-17T02:47:38.501417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:33:12.989420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518171+0000","last_change":"2024-08-17T02:47:38.518171+0000","last_active":"2024-08-17T02:47:38.518171+0000","last_peered":"2024-08-17T02:47:38.518171+0000","last_clean":"2024-08-17T02:47:38.518171+0000","last_became_active":"2024-08-17T02:47:38.517499+0000","last_became_peered":"2024-08-17T02:47:38.517499+0000","last_unstale":"2024-08-17T02:47:38.518171+0000","last_undegraded":"2024-08-17T02:47:38.518171+0000","last_fullsized":"2024-08-17T02:47:38.518171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:07:14.982848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503938+0000","last_change":"2024-08-17T02:47:37.500902+0000","last_active":"2024-08-17T02:47:38.503938+0000","last_peered":"2024-08-17T02:47:38.503938+0000","last_clean":"2024-08-17T02:47:38.503938+0000","last_became_active":"2024-08-17T02:47:37.500617+0000","last_became_peered":"2024-08-17T02:47:37.500617+0000","last_unstale":"2024-08-17T02:47:38.503938+0000","last_undegraded":"2024-08-17T02:47:38.503938+0000","last_fullsized":"2024-08-17T02:47:38.503938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:32.342661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514183+0000","last_change":"2024-08-17T02:47:38.512527+0000","last_active":"2024-08-17T02:47:38.514183+0000","last_peered":"2024-08-17T02:47:38.514183+0000","last_clean":"2024-08-17T02:47:38.514183+0000","last_became_active":"2024-08-17T02:47:38.512289+0000","last_became_peered":"2024-08-17T02:47:38.512289+0000","last_unstale":"2024-08-17T02:47:38.514183+0000","last_undegraded":"2024-08-17T02:47:38.514183+0000","last_fullsized":"2024-08-17T02:47:38.514183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:00.434889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.502244+0000","last_change":"2024-08-17T02:47:37.495694+0000","last_active":"2024-08-17T02:47:37.502244+0000","last_peered":"2024-08-17T02:47:37.502244+0000","last_clean":"2024-08-17T02:47:37.502244+0000","last_became_active":"2024-08-17T02:47:37.495435+0000","last_became_peered":"2024-08-17T02:47:37.495435+0000","last_unstale":"2024-08-17T02:47:37.502244+0000","last_undegraded":"2024-08-17T02:47:37.502244+0000","last_fullsized":"2024-08-17T02:47:37.502244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:32:35.671408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.527509+0000","last_change":"2024-08-17T02:47:38.518285+0000","last_active":"2024-08-17T02:47:38.527509+0000","last_peered":"2024-08-17T02:47:38.527509+0000","last_clean":"2024-08-17T02:47:38.527509+0000","last_became_active":"2024-08-17T02:47:38.518063+0000","last_became_peered":"2024-08-17T02:47:38.518063+0000","last_unstale":"2024-08-17T02:47:38.527509+0000","last_undegraded":"2024-08-17T02:47:38.527509+0000","last_fullsized":"2024-08-17T02:47:38.527509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:23.733775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.502774+0000","last_change":"2024-08-17T02:47:37.506239+0000","last_active":"2024-08-17T02:47:38.502774+0000","last_peered":"2024-08-17T02:47:38.502774+0000","last_clean":"2024-08-17T02:47:38.502774+0000","last_became_active":"2024-08-17T02:47:37.505989+0000","last_became_peered":"2024-08-17T02:47:37.505989+0000","last_unstale":"2024-08-17T02:47:38.502774+0000","last_undegraded":"2024-08-17T02:47:38.502774+0000","last_fullsized":"2024-08-17T02:47:38.502774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:47:01.082107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517413+0000","last_change":"2024-08-17T02:47:38.511054+0000","last_active":"2024-08-17T02:47:38.517413+0000","last_peered":"2024-08-17T02:47:38.517413+0000","last_clean":"2024-08-17T02:47:38.517413+0000","last_became_active":"2024-08-17T02:47:38.510817+0000","last_became_peered":"2024-08-17T02:47:38.510817+0000","last_unstale":"2024-08-17T02:47:38.517413+0000","last_undegraded":"2024-08-17T02:47:38.517413+0000","last_fullsized":"2024-08-17T02:47:38.517413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:57.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503629+0000","last_change":"2024-08-17T02:47:37.500291+0000","last_active":"2024-08-17T02:47:38.503629+0000","last_peered":"2024-08-17T02:47:38.503629+0000","last_clean":"2024-08-17T02:47:38.503629+0000","last_became_active":"2024-08-17T02:47:37.500058+0000","last_became_peered":"2024-08-17T02:47:37.500058+0000","last_unstale":"2024-08-17T02:47:38.503629+0000","last_undegraded":"2024-08-17T02:47:38.503629+0000","last_fullsized":"2024-08-17T02:47:38.503629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:09.327150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.523881+0000","last_change":"2024-08-17T02:47:38.521455+0000","last_active":"2024-08-17T02:47:38.523881+0000","last_peered":"2024-08-17T02:47:38.523881+0000","last_clean":"2024-08-17T02:47:38.523881+0000","last_became_active":"2024-08-17T02:47:38.519445+0000","last_became_peered":"2024-08-17T02:47:38.519445+0000","last_unstale":"2024-08-17T02:47:38.523881+0000","last_undegraded":"2024-08-17T02:47:38.523881+0000","last_fullsized":"2024-08-17T02:47:38.523881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:15.901785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.531475+0000","last_change":"2024-08-17T02:47:37.503379+0000","last_active":"2024-08-17T02:47:38.531475+0000","last_peered":"2024-08-17T02:47:38.531475+0000","last_clean":"2024-08-17T02:47:38.531475+0000","last_became_active":"2024-08-17T02:47:37.503140+0000","last_became_peered":"2024-08-17T02:47:37.503140+0000","last_unstale":"2024-08-17T02:47:38.531475+0000","last_undegraded":"2024-08-17T02:47:38.531475+0000","last_fullsized":"2024-08-17T02:47:38.531475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:36.168296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515765+0000","last_change":"2024-08-17T02:47:38.509599+0000","last_active":"2024-08-17T02:47:38.515765+0000","last_peered":"2024-08-17T02:47:38.515765+0000","last_clean":"2024-08-17T02:47:38.515765+0000","last_became_active":"2024-08-17T02:47:38.509205+0000","last_became_peered":"2024-08-17T02:47:38.509205+0000","last_unstale":"2024-08-17T02:47:38.515765+0000","last_undegraded":"2024-08-17T02:47:38.515765+0000","last_fullsized":"2024-08-17T02:47:38.515765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:26.063659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.536091+0000","last_change":"2024-08-17T02:47:37.507701+0000","last_active":"2024-08-17T02:47:38.536091+0000","last_peered":"2024-08-17T02:47:38.536091+0000","last_clean":"2024-08-17T02:47:38.536091+0000","last_became_active":"2024-08-17T02:47:37.507469+0000","last_became_peered":"2024-08-17T02:47:37.507469+0000","last_unstale":"2024-08-17T02:47:38.536091+0000","last_undegraded":"2024-08-17T02:47:38.536091+0000","last_fullsized":"2024-08-17T02:47:38.536091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:53.258054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513591+0000","last_change":"2024-08-17T02:47:38.512232+0000","last_active":"2024-08-17T02:47:38.513591+0000","last_peered":"2024-08-17T02:47:38.513591+0000","last_clean":"2024-08-17T02:47:38.513591+0000","last_became_active":"2024-08-17T02:47:38.511942+0000","last_became_peered":"2024-08-17T02:47:38.511942+0000","last_unstale":"2024-08-17T02:47:38.513591+0000","last_undegraded":"2024-08-17T02:47:38.513591+0000","last_fullsized":"2024-08-17T02:47:38.513591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:32:22.769124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.534173+0000","last_change":"2024-08-17T02:47:37.502360+0000","last_active":"2024-08-17T02:47:38.534173+0000","last_peered":"2024-08-17T02:47:38.534173+0000","last_clean":"2024-08-17T02:47:38.534173+0000","last_became_active":"2024-08-17T02:47:37.502063+0000","last_became_peered":"2024-08-17T02:47:37.502063+0000","last_unstale":"2024-08-17T02:47:38.534173+0000","last_undegraded":"2024-08-17T02:47:38.534173+0000","last_fullsized":"2024-08-17T02:47:38.534173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:08.668805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516749+0000","last_change":"2024-08-17T02:47:38.510004+0000","last_active":"2024-08-17T02:47:38.516749+0000","last_peered":"2024-08-17T02:47:38.516749+0000","last_clean":"2024-08-17T02:47:38.516749+0000","last_became_active":"2024-08-17T02:47:38.509551+0000","last_became_peered":"2024-08-17T02:47:38.509551+0000","last_unstale":"2024-08-17T02:47:38.516749+0000","last_undegraded":"2024-08-17T02:47:38.516749+0000","last_fullsized":"2024-08-17T02:47:38.516749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:41.221396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.493993+0000","last_change":"2024-08-17T02:47:37.495698+0000","last_active":"2024-08-17T02:47:38.493993+0000","last_peered":"2024-08-17T02:47:38.493993+0000","last_clean":"2024-08-17T02:47:38.493993+0000","last_became_active":"2024-08-17T02:47:37.495461+0000","last_became_peered":"2024-08-17T02:47:37.495461+0000","last_unstale":"2024-08-17T02:47:38.493993+0000","last_undegraded":"2024-08-17T02:47:38.493993+0000","last_fullsized":"2024-08-17T02:47:38.493993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:32.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522508+0000","last_change":"2024-08-17T02:47:38.522508+0000","last_active":"2024-08-17T02:47:38.522508+0000","last_peered":"2024-08-17T02:47:38.522508+0000","last_clean":"2024-08-17T02:47:38.522508+0000","last_became_active":"2024-08-17T02:47:38.522072+0000","last_became_peered":"2024-08-17T02:47:38.522072+0000","last_unstale":"2024-08-17T02:47:38.522508+0000","last_undegraded":"2024-08-17T02:47:38.522508+0000","last_fullsized":"2024-08-17T02:47:38.522508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:31.699154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.508941+0000","last_change":"2024-08-17T02:47:37.507198+0000","last_active":"2024-08-17T02:47:38.508941+0000","last_peered":"2024-08-17T02:47:38.508941+0000","last_clean":"2024-08-17T02:47:38.508941+0000","last_became_active":"2024-08-17T02:47:37.506925+0000","last_became_peered":"2024-08-17T02:47:37.506925+0000","last_unstale":"2024-08-17T02:47:38.508941+0000","last_undegraded":"2024-08-17T02:47:38.508941+0000","last_fullsized":"2024-08-17T02:47:38.508941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:48.420405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.520895+0000","last_change":"2024-08-17T02:47:38.520895+0000","last_active":"2024-08-17T02:47:38.520895+0000","last_peered":"2024-08-17T02:47:38.520895+0000","last_clean":"2024-08-17T02:47:38.520895+0000","last_became_active":"2024-08-17T02:47:38.520651+0000","last_became_peered":"2024-08-17T02:47:38.520651+0000","last_unstale":"2024-08-17T02:47:38.520895+0000","last_undegraded":"2024-08-17T02:47:38.520895+0000","last_fullsized":"2024-08-17T02:47:38.520895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:10.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.534621+0000","last_change":"2024-08-17T02:47:37.505221+0000","last_active":"2024-08-17T02:47:38.534621+0000","last_peered":"2024-08-17T02:47:38.534621+0000","last_clean":"2024-08-17T02:47:38.534621+0000","last_became_active":"2024-08-17T02:47:37.504914+0000","last_became_peered":"2024-08-17T02:47:37.504914+0000","last_unstale":"2024-08-17T02:47:38.534621+0000","last_undegraded":"2024-08-17T02:47:38.534621+0000","last_fullsized":"2024-08-17T02:47:38.534621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:57.611241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515349+0000","last_change":"2024-08-17T02:47:38.515349+0000","last_active":"2024-08-17T02:47:38.515349+0000","last_peered":"2024-08-17T02:47:38.515349+0000","last_clean":"2024-08-17T02:47:38.515349+0000","last_became_active":"2024-08-17T02:47:38.515100+0000","last_became_peered":"2024-08-17T02:47:38.515100+0000","last_unstale":"2024-08-17T02:47:38.515349+0000","last_undegraded":"2024-08-17T02:47:38.515349+0000","last_fullsized":"2024-08-17T02:47:38.515349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:16.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.525494+0000","last_change":"2024-08-17T02:47:37.509117+0000","last_active":"2024-08-17T02:47:38.525494+0000","last_peered":"2024-08-17T02:47:38.525494+0000","last_clean":"2024-08-17T02:47:38.525494+0000","last_became_active":"2024-08-17T02:47:37.508702+0000","last_became_peered":"2024-08-17T02:47:37.508702+0000","last_unstale":"2024-08-17T02:47:38.525494+0000","last_undegraded":"2024-08-17T02:47:38.525494+0000","last_fullsized":"2024-08-17T02:47:38.525494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:55.911111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.528101+0000","last_change":"2024-08-17T02:47:38.519855+0000","last_active":"2024-08-17T02:47:38.528101+0000","last_peered":"2024-08-17T02:47:38.528101+0000","last_clean":"2024-08-17T02:47:38.528101+0000","last_became_active":"2024-08-17T02:47:38.519194+0000","last_became_peered":"2024-08-17T02:47:38.519194+0000","last_unstale":"2024-08-17T02:47:38.528101+0000","last_undegraded":"2024-08-17T02:47:38.528101+0000","last_fullsized":"2024-08-17T02:47:38.528101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:15.123760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.534192+0000","last_change":"2024-08-17T02:47:37.501645+0000","last_active":"2024-08-17T02:47:38.534192+0000","last_peered":"2024-08-17T02:47:38.534192+0000","last_clean":"2024-08-17T02:47:38.534192+0000","last_became_active":"2024-08-17T02:47:37.501400+0000","last_became_peered":"2024-08-17T02:47:37.501400+0000","last_unstale":"2024-08-17T02:47:38.534192+0000","last_undegraded":"2024-08-17T02:47:38.534192+0000","last_fullsized":"2024-08-17T02:47:38.534192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:29:09.183917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519877+0000","last_change":"2024-08-17T02:47:38.518068+0000","last_active":"2024-08-17T02:47:38.519877+0000","last_peered":"2024-08-17T02:47:38.519877+0000","last_clean":"2024-08-17T02:47:38.519877+0000","last_became_active":"2024-08-17T02:47:38.517521+0000","last_became_peered":"2024-08-17T02:47:38.517521+0000","last_unstale":"2024-08-17T02:47:38.519877+0000","last_undegraded":"2024-08-17T02:47:38.519877+0000","last_fullsized":"2024-08-17T02:47:38.519877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:55.156017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503209+0000","last_change":"2024-08-17T02:47:37.500643+0000","last_active":"2024-08-17T02:47:38.503209+0000","last_peered":"2024-08-17T02:47:38.503209+0000","last_clean":"2024-08-17T02:47:38.503209+0000","last_became_active":"2024-08-17T02:47:37.500376+0000","last_became_peered":"2024-08-17T02:47:37.500376+0000","last_unstale":"2024-08-17T02:47:38.503209+0000","last_undegraded":"2024-08-17T02:47:38.503209+0000","last_fullsized":"2024-08-17T02:47:38.503209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:51:53.607024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521844+0000","last_change":"2024-08-17T02:47:38.516532+0000","last_active":"2024-08-17T02:47:38.521844+0000","last_peered":"2024-08-17T02:47:38.521844+0000","last_clean":"2024-08-17T02:47:38.521844+0000","last_became_active":"2024-08-17T02:47:38.516214+0000","last_became_peered":"2024-08-17T02:47:38.516214+0000","last_unstale":"2024-08-17T02:47:38.521844+0000","last_undegraded":"2024-08-17T02:47:38.521844+0000","last_fullsized":"2024-08-17T02:47:38.521844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:32:22.769124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.510635+0000","last_change":"2024-08-17T02:47:37.509149+0000","last_active":"2024-08-17T02:47:37.510635+0000","last_peered":"2024-08-17T02:47:37.510635+0000","last_clean":"2024-08-17T02:47:37.510635+0000","last_became_active":"2024-08-17T02:47:37.508801+0000","last_became_peered":"2024-08-17T02:47:37.508801+0000","last_unstale":"2024-08-17T02:47:37.510635+0000","last_undegraded":"2024-08-17T02:47:37.510635+0000","last_fullsized":"2024-08-17T02:47:37.510635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:30.833450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517346+0000","last_change":"2024-08-17T02:47:38.514652+0000","last_active":"2024-08-17T02:47:38.517346+0000","last_peered":"2024-08-17T02:47:38.517346+0000","last_clean":"2024-08-17T02:47:38.517346+0000","last_became_active":"2024-08-17T02:47:38.513618+0000","last_became_peered":"2024-08-17T02:47:38.513618+0000","last_unstale":"2024-08-17T02:47:38.517346+0000","last_undegraded":"2024-08-17T02:47:38.517346+0000","last_fullsized":"2024-08-17T02:47:38.517346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:00.434889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.528757+0000","last_change":"2024-08-17T02:47:37.497844+0000","last_active":"2024-08-17T02:47:38.528757+0000","last_peered":"2024-08-17T02:47:38.528757+0000","last_clean":"2024-08-17T02:47:38.528757+0000","last_became_active":"2024-08-17T02:47:37.495785+0000","last_became_peered":"2024-08-17T02:47:37.495785+0000","last_unstale":"2024-08-17T02:47:38.528757+0000","last_undegraded":"2024-08-17T02:47:38.528757+0000","last_fullsized":"2024-08-17T02:47:38.528757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:19.774557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516155+0000","last_change":"2024-08-17T02:47:38.509823+0000","last_active":"2024-08-17T02:47:38.516155+0000","last_peered":"2024-08-17T02:47:38.516155+0000","last_clean":"2024-08-17T02:47:38.516155+0000","last_became_active":"2024-08-17T02:47:38.509588+0000","last_became_peered":"2024-08-17T02:47:38.509588+0000","last_unstale":"2024-08-17T02:47:38.516155+0000","last_undegraded":"2024-08-17T02:47:38.516155+0000","last_fullsized":"2024-08-17T02:47:38.516155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:47:02.088588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.505330+0000","last_change":"2024-08-17T02:47:37.501371+0000","last_active":"2024-08-17T02:47:37.505330+0000","last_peered":"2024-08-17T02:47:37.505330+0000","last_clean":"2024-08-17T02:47:37.505330+0000","last_became_active":"2024-08-17T02:47:37.501127+0000","last_became_peered":"2024-08-17T02:47:37.501127+0000","last_unstale":"2024-08-17T02:47:37.505330+0000","last_undegraded":"2024-08-17T02:47:37.505330+0000","last_fullsized":"2024-08-17T02:47:37.505330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:03.700538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.508486+0000","last_change":"2024-08-17T02:47:38.505804+0000","last_active":"2024-08-17T02:47:38.508486+0000","last_peered":"2024-08-17T02:47:38.508486+0000","last_clean":"2024-08-17T02:47:38.508486+0000","last_became_active":"2024-08-17T02:47:38.504775+0000","last_became_peered":"2024-08-17T02:47:38.504775+0000","last_unstale":"2024-08-17T02:47:38.508486+0000","last_undegraded":"2024-08-17T02:47:38.508486+0000","last_fullsized":"2024-08-17T02:47:38.508486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:49.426886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.508371+0000","last_change":"2024-08-17T02:47:37.505465+0000","last_active":"2024-08-17T02:47:37.508371+0000","last_peered":"2024-08-17T02:47:37.508371+0000","last_clean":"2024-08-17T02:47:37.508371+0000","last_became_active":"2024-08-17T02:47:37.504868+0000","last_became_peered":"2024-08-17T02:47:37.504868+0000","last_unstale":"2024-08-17T02:47:37.508371+0000","last_undegraded":"2024-08-17T02:47:37.508371+0000","last_fullsized":"2024-08-17T02:47:37.508371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:13.378723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.524440+0000","last_change":"2024-08-17T02:47:38.524440+0000","last_active":"2024-08-17T02:47:38.524440+0000","last_peered":"2024-08-17T02:47:38.524440+0000","last_clean":"2024-08-17T02:47:38.524440+0000","last_became_active":"2024-08-17T02:47:38.524160+0000","last_became_peered":"2024-08-17T02:47:38.524160+0000","last_unstale":"2024-08-17T02:47:38.524440+0000","last_undegraded":"2024-08-17T02:47:38.524440+0000","last_fullsized":"2024-08-17T02:47:38.524440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:15.123760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.499018+0000","last_change":"2024-08-17T02:47:37.507914+0000","last_active":"2024-08-17T02:47:38.499018+0000","last_peered":"2024-08-17T02:47:38.499018+0000","last_clean":"2024-08-17T02:47:38.499018+0000","last_became_active":"2024-08-17T02:47:37.507518+0000","last_became_peered":"2024-08-17T02:47:37.507518+0000","last_unstale":"2024-08-17T02:47:38.499018+0000","last_undegraded":"2024-08-17T02:47:38.499018+0000","last_fullsized":"2024-08-17T02:47:38.499018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:53.201527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516899+0000","last_change":"2024-08-17T02:47:38.510024+0000","last_active":"2024-08-17T02:47:38.516899+0000","last_peered":"2024-08-17T02:47:38.516899+0000","last_clean":"2024-08-17T02:47:38.516899+0000","last_became_active":"2024-08-17T02:47:38.509759+0000","last_became_peered":"2024-08-17T02:47:38.509759+0000","last_unstale":"2024-08-17T02:47:38.516899+0000","last_undegraded":"2024-08-17T02:47:38.516899+0000","last_fullsized":"2024-08-17T02:47:38.516899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.617723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.529637+0000","last_change":"2024-08-17T02:47:37.500921+0000","last_active":"2024-08-17T02:47:38.529637+0000","last_peered":"2024-08-17T02:47:38.529637+0000","last_clean":"2024-08-17T02:47:38.529637+0000","last_became_active":"2024-08-17T02:47:37.500587+0000","last_became_peered":"2024-08-17T02:47:37.500587+0000","last_unstale":"2024-08-17T02:47:38.529637+0000","last_undegraded":"2024-08-17T02:47:38.529637+0000","last_fullsized":"2024-08-17T02:47:38.529637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:52.343413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519937+0000","last_change":"2024-08-17T02:47:38.510712+0000","last_active":"2024-08-17T02:47:38.519937+0000","last_peered":"2024-08-17T02:47:38.519937+0000","last_clean":"2024-08-17T02:47:38.519937+0000","last_became_active":"2024-08-17T02:47:38.507397+0000","last_became_peered":"2024-08-17T02:47:38.507397+0000","last_unstale":"2024-08-17T02:47:38.519937+0000","last_undegraded":"2024-08-17T02:47:38.519937+0000","last_fullsized":"2024-08-17T02:47:38.519937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:31.699154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503714+0000","last_change":"2024-08-17T02:47:37.497714+0000","last_active":"2024-08-17T02:47:38.503714+0000","last_peered":"2024-08-17T02:47:38.503714+0000","last_clean":"2024-08-17T02:47:38.503714+0000","last_became_active":"2024-08-17T02:47:37.497480+0000","last_became_peered":"2024-08-17T02:47:37.497480+0000","last_unstale":"2024-08-17T02:47:38.503714+0000","last_undegraded":"2024-08-17T02:47:38.503714+0000","last_fullsized":"2024-08-17T02:47:38.503714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.893107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.507394+0000","last_change":"2024-08-17T02:47:38.505533+0000","last_active":"2024-08-17T02:47:38.507394+0000","last_peered":"2024-08-17T02:47:38.507394+0000","last_clean":"2024-08-17T02:47:38.507394+0000","last_became_active":"2024-08-17T02:47:38.505257+0000","last_became_peered":"2024-08-17T02:47:38.505257+0000","last_unstale":"2024-08-17T02:47:38.507394+0000","last_undegraded":"2024-08-17T02:47:38.507394+0000","last_fullsized":"2024-08-17T02:47:38.507394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.494774+0000","last_change":"2024-08-17T02:47:37.503519+0000","last_active":"2024-08-17T02:47:38.494774+0000","last_peered":"2024-08-17T02:47:38.494774+0000","last_clean":"2024-08-17T02:47:38.494774+0000","last_became_active":"2024-08-17T02:47:37.503262+0000","last_became_peered":"2024-08-17T02:47:37.503262+0000","last_unstale":"2024-08-17T02:47:38.494774+0000","last_undegraded":"2024-08-17T02:47:38.494774+0000","last_fullsized":"2024-08-17T02:47:38.494774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:12.341091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515241+0000","last_change":"2024-08-17T02:47:38.515241+0000","last_active":"2024-08-17T02:47:38.515241+0000","last_peered":"2024-08-17T02:47:38.515241+0000","last_clean":"2024-08-17T02:47:38.515241+0000","last_became_active":"2024-08-17T02:47:38.514959+0000","last_became_peered":"2024-08-17T02:47:38.514959+0000","last_unstale":"2024-08-17T02:47:38.515241+0000","last_undegraded":"2024-08-17T02:47:38.515241+0000","last_fullsized":"2024-08-17T02:47:38.515241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:34.765783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.502774+0000","last_change":"2024-08-17T02:47:37.489743+0000","last_active":"2024-08-17T02:47:38.502774+0000","last_peered":"2024-08-17T02:47:38.502774+0000","last_clean":"2024-08-17T02:47:38.502774+0000","last_became_active":"2024-08-17T02:47:37.489314+0000","last_became_peered":"2024-08-17T02:47:37.489314+0000","last_unstale":"2024-08-17T02:47:38.502774+0000","last_undegraded":"2024-08-17T02:47:38.502774+0000","last_fullsized":"2024-08-17T02:47:38.502774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:53.201527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522966+0000","last_change":"2024-08-17T02:47:38.518397+0000","last_active":"2024-08-17T02:47:38.522966+0000","last_peered":"2024-08-17T02:47:38.522966+0000","last_clean":"2024-08-17T02:47:38.522966+0000","last_became_active":"2024-08-17T02:47:38.518168+0000","last_became_peered":"2024-08-17T02:47:38.518168+0000","last_unstale":"2024-08-17T02:47:38.522966+0000","last_undegraded":"2024-08-17T02:47:38.522966+0000","last_fullsized":"2024-08-17T02:47:38.522966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:24.329977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.494089+0000","last_change":"2024-08-17T02:47:37.501022+0000","last_active":"2024-08-17T02:47:38.494089+0000","last_peered":"2024-08-17T02:47:38.494089+0000","last_clean":"2024-08-17T02:47:38.494089+0000","last_became_active":"2024-08-17T02:47:37.500754+0000","last_became_peered":"2024-08-17T02:47:37.500754+0000","last_unstale":"2024-08-17T02:47:38.494089+0000","last_undegraded":"2024-08-17T02:47:38.494089+0000","last_fullsized":"2024-08-17T02:47:38.494089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:19:32.899700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517188+0000","last_change":"2024-08-17T02:47:38.515576+0000","last_active":"2024-08-17T02:47:38.517188+0000","last_peered":"2024-08-17T02:47:38.517188+0000","last_clean":"2024-08-17T02:47:38.517188+0000","last_became_active":"2024-08-17T02:47:38.514090+0000","last_became_peered":"2024-08-17T02:47:38.514090+0000","last_unstale":"2024-08-17T02:47:38.517188+0000","last_undegraded":"2024-08-17T02:47:38.517188+0000","last_fullsized":"2024-08-17T02:47:38.517188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:38.159312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.502269+0000","last_change":"2024-08-17T02:47:37.497826+0000","last_active":"2024-08-17T02:47:37.502269+0000","last_peered":"2024-08-17T02:47:37.502269+0000","last_clean":"2024-08-17T02:47:37.502269+0000","last_became_active":"2024-08-17T02:47:37.497531+0000","last_became_peered":"2024-08-17T02:47:37.497531+0000","last_unstale":"2024-08-17T02:47:37.502269+0000","last_undegraded":"2024-08-17T02:47:37.502269+0000","last_fullsized":"2024-08-17T02:47:37.502269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:03.700538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.520331+0000","last_change":"2024-08-17T02:47:38.520331+0000","last_active":"2024-08-17T02:47:38.520331+0000","last_peered":"2024-08-17T02:47:38.520331+0000","last_clean":"2024-08-17T02:47:38.520331+0000","last_became_active":"2024-08-17T02:47:38.520018+0000","last_became_peered":"2024-08-17T02:47:38.520018+0000","last_unstale":"2024-08-17T02:47:38.520331+0000","last_undegraded":"2024-08-17T02:47:38.520331+0000","last_fullsized":"2024-08-17T02:47:38.520331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:31.856692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503644+0000","last_change":"2024-08-17T02:47:37.507656+0000","last_active":"2024-08-17T02:47:38.503644+0000","last_peered":"2024-08-17T02:47:38.503644+0000","last_clean":"2024-08-17T02:47:38.503644+0000","last_became_active":"2024-08-17T02:47:37.507362+0000","last_became_peered":"2024-08-17T02:47:37.507362+0000","last_unstale":"2024-08-17T02:47:38.503644+0000","last_undegraded":"2024-08-17T02:47:38.503644+0000","last_fullsized":"2024-08-17T02:47:38.503644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:31:51.924232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513049+0000","last_change":"2024-08-17T02:47:38.513049+0000","last_active":"2024-08-17T02:47:38.513049+0000","last_peered":"2024-08-17T02:47:38.513049+0000","last_clean":"2024-08-17T02:47:38.513049+0000","last_became_active":"2024-08-17T02:47:38.512760+0000","last_became_peered":"2024-08-17T02:47:38.512760+0000","last_unstale":"2024-08-17T02:47:38.513049+0000","last_undegraded":"2024-08-17T02:47:38.513049+0000","last_fullsized":"2024-08-17T02:47:38.513049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:16.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.505770+0000","last_change":"2024-08-17T02:47:37.502613+0000","last_active":"2024-08-17T02:47:37.505770+0000","last_peered":"2024-08-17T02:47:37.505770+0000","last_clean":"2024-08-17T02:47:37.505770+0000","last_became_active":"2024-08-17T02:47:37.502393+0000","last_became_peered":"2024-08-17T02:47:37.502393+0000","last_unstale":"2024-08-17T02:47:37.505770+0000","last_undegraded":"2024-08-17T02:47:37.505770+0000","last_fullsized":"2024-08-17T02:47:37.505770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:13.378723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.503380+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:47:37.503380+0000","last_peered":"2024-08-17T02:47:37.503380+0000","last_clean":"2024-08-17T02:47:37.503380+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:47:37.503380+0000","last_undegraded":"2024-08-17T02:47:37.503380+0000","last_fullsized":"2024-08-17T02:47:37.503380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":962560,"data_stored":730133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.79600000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.871},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.76600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":372736,"data_stored":140279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.752}]},{"osd":1,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.59299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67900000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":385024,"data_stored":146623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.629},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.752},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.72799999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":372736,"data_stored":139779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.629}]},{"osd":1,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.501},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.46800000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68899999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":393216,"data_stored":147537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.441}]},{"osd":1,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.374},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.67000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":380928,"data_stored":146033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.505},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.80800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.629}]},{"osd":7,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.66400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":380928,"data_stored":141249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9169999999999998,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":2.9169999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.7709999999999999,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":4.7709999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":2.274}]},{"osd":3,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":3.653},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.284},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":3.9660000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":4.3120000000000003},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":6.3120000000000003,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":6.3120000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":4.0060000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":9.5500000000000007,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":9.5500000000000007},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":8.7720000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":958464,"data_stored":730043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.495},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.623},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.749},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:42.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:42.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.849+0000 7f3332600640 1 Processor -- start 2024-08-17T02:47:42.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.849+0000 7f3332600640 1 -- start start 2024-08-17T02:47:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f3332600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f332c158f80 0x7f332c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f3332600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f332c0cf280 0x7f332c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f3332600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0cb560 con 0x7f332c159350 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f3332600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0cf7e0 con 0x7f332c158f80 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f3332600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0cfac0 con 0x7f332c0cf280 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f332b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f332c158f80 0x7f332c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f332b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f332c158f80 0x7f332c0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56382/0 (socket says 172.21.15.149:56382) 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.850+0000 7f332b400640 1 -- 172.21.15.149:0/1194413167 learned_addr learned my addr 172.21.15.149:0/1194413167 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.851+0000 7f332be00640 1 --2- 172.21.15.149:0/1194413167 >> v2:172.21.15.161:3300/0 conn(0x7f332c0cf280 0x7f332c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.851+0000 7f332b400640 1 -- 172.21.15.149:0/1194413167 >> v2:172.21.15.161:3300/0 conn(0x7f332c0cf280 msgr2=0x7f332c0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.851+0000 7f332b400640 1 --2- 172.21.15.149:0/1194413167 >> v2:172.21.15.161:3300/0 conn(0x7f332c0cf280 0x7f332c0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.851+0000 7f332b400640 1 -- 172.21.15.149:0/1194413167 >> v1:172.21.15.161:6789/0 conn(0x7f332c159350 legacy=0x7f332c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.851+0000 7f332b400640 1 -- 172.21.15.149:0/1194413167 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0caf10 con 0x7f332c158f80 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.852+0000 7f332b400640 1 --2- 172.21.15.149:0/1194413167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c158f80 0x7f332c0ca330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f332c08a230 tx=0x7f331c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee377204bb630949 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.852+0000 7f332a000640 1 -- 172.21.15.149:0/1194413167 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c02ade0 con 0x7f332c158f80 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.852+0000 7f332a000640 1 -- 172.21.15.149:0/1194413167 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c032440 con 0x7f332c158f80 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.852+0000 7f332a000640 1 -- 172.21.15.149:0/1194413167 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c032820 con 0x7f332c158f80 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 -- 172.21.15.149:0/1194413167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c158f80 msgr2=0x7f332c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 --2- 172.21.15.149:0/1194413167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c158f80 0x7f332c0ca330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f332c08a230 tx=0x7f331c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 -- 172.21.15.149:0/1194413167 shutdown_connections 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 --2- 172.21.15.149:0/1194413167 >> v2:172.21.15.161:3300/0 conn(0x7f332c0cf280 0x7f332c0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 --2- 172.21.15.149:0/1194413167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c158f80 0x7f332c0ca330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 -- 172.21.15.149:0/1194413167 >> 172.21.15.149:0/1194413167 conn(0x7f332c0cfd90 msgr2=0x7f332c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 -- 172.21.15.149:0/1194413167 shutdown_connections 2024-08-17T02:47:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.853+0000 7f3332600640 1 -- 172.21.15.149:0/1194413167 wait complete. 2024-08-17T02:47:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.854+0000 7f3332600640 1 Processor -- start 2024-08-17T02:47:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 -- start start 2024-08-17T02:47:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f332c0cf280 0x7f332c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f332c158f80 0x7f332c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 0x7f332c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0b4580 con 0x7f332c159350 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c169b30 con 0x7f332c158f80 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.855+0000 7f3332600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1697f0 con 0x7f332c0cf280 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 0x7f332c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 0x7f332c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56394/0 (socket says 172.21.15.149:56394) 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 -- 172.21.15.149:0/2805795874 learned_addr learned my addr 172.21.15.149:0/2805795874 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332b400640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f332c0cf280 0x7f332c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332aa00640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f332c158f80 0x7f332c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 -- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f332c0cf280 msgr2=0x7f332c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f332c0cf280 0x7f332c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 -- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f332c158f80 msgr2=0x7f332c0b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f332c158f80 0x7f332c0b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 -- 172.21.15.149:0/2805795874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c009450 con 0x7f332c159350 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.856+0000 7f332be00640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 0x7f332c156ec0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3324007f20 tx=0x7f3324009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.857+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400edd0 con 0x7f332c159350 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.857+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324014420 con 0x7f332c159350 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.857+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c0b3a50 con 0x7f332c159350 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.857+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240147e0 con 0x7f332c159350 2024-08-17T02:47:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.857+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c0b3fc0 con 0x7f332c159350 2024-08-17T02:47:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.858+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c169c70 con 0x7f332c159350 2024-08-17T02:47:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.859+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3324014b50 con 0x7f332c159350 2024-08-17T02:47:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.859+0000 7f3322a00640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f330c065150 0x7f330c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.859+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3324082a00 con 0x7f332c159350 2024-08-17T02:47:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.860+0000 7f332b400640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f330c065150 0x7f330c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.860+0000 7f332b400640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f330c065150 0x7f330c067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f331c034000 tx=0x7f331c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:42.863+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3324050b70 con 0x7f332c159350 2024-08-17T02:47:43.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.034+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f332c064db0 con 0x7f330c065150 2024-08-17T02:47:43.043 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.041+0000 7f3322a00640 1 -- 172.21.15.149:0/2805795874 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288717 (secure 0 0 0) 0x7f332c064db0 con 0x7f330c065150 2024-08-17T02:47:43.047 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:43.048 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f330c065150 msgr2=0x7f330c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f330c065150 0x7f330c067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f331c034000 tx=0x7f331c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 msgr2=0x7f332c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 0x7f332c156ec0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3324007f20 tx=0x7f3324009860 comp rx=0 tx=0).stop 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 shutdown_connections 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f330c065150 0x7f330c067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f332c159350 0x7f332c156ec0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f332c158f80 0x7f332c0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 --2- 172.21.15.149:0/2805795874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f332c0cf280 0x7f332c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.045+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 >> 172.21.15.149:0/2805795874 conn(0x7f332c0cfd90 msgr2=0x7f332c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.046+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 shutdown_connections 2024-08-17T02:47:43.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.046+0000 7f3332600640 1 -- 172.21.15.149:0/2805795874 wait complete. 2024-08-17T02:47:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-08-17T02:47:41.635858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382992,"kb_used_data":4108,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591728,"statfs":{"total":773094113280,"available":770653929472,"internally_reserved":0,"allocated":4206592,"data_stored":2321676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.160006"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.526063+0000","last_change":"2024-08-17T02:47:38.526063+0000","last_active":"2024-08-17T02:47:38.526063+0000","last_peered":"2024-08-17T02:47:38.526063+0000","last_clean":"2024-08-17T02:47:38.526063+0000","last_became_active":"2024-08-17T02:47:38.525823+0000","last_became_peered":"2024-08-17T02:47:38.525823+0000","last_unstale":"2024-08-17T02:47:38.526063+0000","last_undegraded":"2024-08-17T02:47:38.526063+0000","last_fullsized":"2024-08-17T02:47:38.526063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:04:28.096254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516821+0000","last_change":"2024-08-17T02:47:38.509459+0000","last_active":"2024-08-17T02:47:38.516821+0000","last_peered":"2024-08-17T02:47:38.516821+0000","last_clean":"2024-08-17T02:47:38.516821+0000","last_became_active":"2024-08-17T02:47:38.509218+0000","last_became_peered":"2024-08-17T02:47:38.509218+0000","last_unstale":"2024-08-17T02:47:38.516821+0000","last_undegraded":"2024-08-17T02:47:38.516821+0000","last_fullsized":"2024-08-17T02:47:38.516821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:32.253080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515735+0000","last_change":"2024-08-17T02:47:38.509568+0000","last_active":"2024-08-17T02:47:38.515735+0000","last_peered":"2024-08-17T02:47:38.515735+0000","last_clean":"2024-08-17T02:47:38.515735+0000","last_became_active":"2024-08-17T02:47:38.509192+0000","last_became_peered":"2024-08-17T02:47:38.509192+0000","last_unstale":"2024-08-17T02:47:38.515735+0000","last_undegraded":"2024-08-17T02:47:38.515735+0000","last_fullsized":"2024-08-17T02:47:38.515735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:51.644235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519894+0000","last_change":"2024-08-17T02:47:38.518219+0000","last_active":"2024-08-17T02:47:38.519894+0000","last_peered":"2024-08-17T02:47:38.519894+0000","last_clean":"2024-08-17T02:47:38.519894+0000","last_became_active":"2024-08-17T02:47:38.517832+0000","last_became_peered":"2024-08-17T02:47:38.517832+0000","last_unstale":"2024-08-17T02:47:38.519894+0000","last_undegraded":"2024-08-17T02:47:38.519894+0000","last_fullsized":"2024-08-17T02:47:38.519894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:10.626577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517075+0000","last_change":"2024-08-17T02:47:38.511559+0000","last_active":"2024-08-17T02:47:38.517075+0000","last_peered":"2024-08-17T02:47:38.517075+0000","last_clean":"2024-08-17T02:47:38.517075+0000","last_became_active":"2024-08-17T02:47:38.511334+0000","last_became_peered":"2024-08-17T02:47:38.511334+0000","last_unstale":"2024-08-17T02:47:38.517075+0000","last_undegraded":"2024-08-17T02:47:38.517075+0000","last_fullsized":"2024-08-17T02:47:38.517075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:29.457883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518290+0000","last_change":"2024-08-17T02:47:38.516843+0000","last_active":"2024-08-17T02:47:38.518290+0000","last_peered":"2024-08-17T02:47:38.518290+0000","last_clean":"2024-08-17T02:47:38.518290+0000","last_became_active":"2024-08-17T02:47:38.516448+0000","last_became_peered":"2024-08-17T02:47:38.516448+0000","last_unstale":"2024-08-17T02:47:38.518290+0000","last_undegraded":"2024-08-17T02:47:38.518290+0000","last_fullsized":"2024-08-17T02:47:38.518290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:03.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.525082+0000","last_change":"2024-08-17T02:47:38.525082+0000","last_active":"2024-08-17T02:47:38.525082+0000","last_peered":"2024-08-17T02:47:38.525082+0000","last_clean":"2024-08-17T02:47:38.525082+0000","last_became_active":"2024-08-17T02:47:38.524824+0000","last_became_peered":"2024-08-17T02:47:38.524824+0000","last_unstale":"2024-08-17T02:47:38.525082+0000","last_undegraded":"2024-08-17T02:47:38.525082+0000","last_fullsized":"2024-08-17T02:47:38.525082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:08.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514400+0000","last_change":"2024-08-17T02:47:38.514400+0000","last_active":"2024-08-17T02:47:38.514400+0000","last_peered":"2024-08-17T02:47:38.514400+0000","last_clean":"2024-08-17T02:47:38.514400+0000","last_became_active":"2024-08-17T02:47:38.510800+0000","last_became_peered":"2024-08-17T02:47:38.510800+0000","last_unstale":"2024-08-17T02:47:38.514400+0000","last_undegraded":"2024-08-17T02:47:38.514400+0000","last_fullsized":"2024-08-17T02:47:38.514400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:24.329977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513974+0000","last_change":"2024-08-17T02:47:38.513974+0000","last_active":"2024-08-17T02:47:38.513974+0000","last_peered":"2024-08-17T02:47:38.513974+0000","last_clean":"2024-08-17T02:47:38.513974+0000","last_became_active":"2024-08-17T02:47:38.513475+0000","last_became_peered":"2024-08-17T02:47:38.513475+0000","last_unstale":"2024-08-17T02:47:38.513974+0000","last_undegraded":"2024-08-17T02:47:38.513974+0000","last_fullsized":"2024-08-17T02:47:38.513974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:48.509277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.527382+0000","last_change":"2024-08-17T02:47:38.525833+0000","last_active":"2024-08-17T02:47:38.527382+0000","last_peered":"2024-08-17T02:47:38.527382+0000","last_clean":"2024-08-17T02:47:38.527382+0000","last_became_active":"2024-08-17T02:47:38.523099+0000","last_became_peered":"2024-08-17T02:47:38.523099+0000","last_unstale":"2024-08-17T02:47:38.527382+0000","last_undegraded":"2024-08-17T02:47:38.527382+0000","last_fullsized":"2024-08-17T02:47:38.527382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:03.879723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.512733+0000","last_change":"2024-08-17T02:47:38.512733+0000","last_active":"2024-08-17T02:47:38.512733+0000","last_peered":"2024-08-17T02:47:38.512733+0000","last_clean":"2024-08-17T02:47:38.512733+0000","last_became_active":"2024-08-17T02:47:38.512493+0000","last_became_peered":"2024-08-17T02:47:38.512493+0000","last_unstale":"2024-08-17T02:47:38.512733+0000","last_undegraded":"2024-08-17T02:47:38.512733+0000","last_fullsized":"2024-08-17T02:47:38.512733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:55:51.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514241+0000","last_change":"2024-08-17T02:47:38.508242+0000","last_active":"2024-08-17T02:47:38.514241+0000","last_peered":"2024-08-17T02:47:38.514241+0000","last_clean":"2024-08-17T02:47:38.514241+0000","last_became_active":"2024-08-17T02:47:38.507977+0000","last_became_peered":"2024-08-17T02:47:38.507977+0000","last_unstale":"2024-08-17T02:47:38.514241+0000","last_undegraded":"2024-08-17T02:47:38.514241+0000","last_fullsized":"2024-08-17T02:47:38.514241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:51.018802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.504982+0000","last_change":"2024-08-17T02:47:38.501046+0000","last_active":"2024-08-17T02:47:38.504982+0000","last_peered":"2024-08-17T02:47:38.504982+0000","last_clean":"2024-08-17T02:47:38.504982+0000","last_became_active":"2024-08-17T02:47:38.500766+0000","last_became_peered":"2024-08-17T02:47:38.500766+0000","last_unstale":"2024-08-17T02:47:38.504982+0000","last_undegraded":"2024-08-17T02:47:38.504982+0000","last_fullsized":"2024-08-17T02:47:38.504982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:54.264535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516704+0000","last_change":"2024-08-17T02:47:38.510520+0000","last_active":"2024-08-17T02:47:38.516704+0000","last_peered":"2024-08-17T02:47:38.516704+0000","last_clean":"2024-08-17T02:47:38.516704+0000","last_became_active":"2024-08-17T02:47:38.508346+0000","last_became_peered":"2024-08-17T02:47:38.508346+0000","last_unstale":"2024-08-17T02:47:38.516704+0000","last_undegraded":"2024-08-17T02:47:38.516704+0000","last_fullsized":"2024-08-17T02:47:38.516704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:41.728557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.523122+0000","last_change":"2024-08-17T02:47:38.516625+0000","last_active":"2024-08-17T02:47:38.523122+0000","last_peered":"2024-08-17T02:47:38.523122+0000","last_clean":"2024-08-17T02:47:38.523122+0000","last_became_active":"2024-08-17T02:47:38.516288+0000","last_became_peered":"2024-08-17T02:47:38.516288+0000","last_unstale":"2024-08-17T02:47:38.523122+0000","last_undegraded":"2024-08-17T02:47:38.523122+0000","last_fullsized":"2024-08-17T02:47:38.523122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:33.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521202+0000","last_change":"2024-08-17T02:47:38.521202+0000","last_active":"2024-08-17T02:47:38.521202+0000","last_peered":"2024-08-17T02:47:38.521202+0000","last_clean":"2024-08-17T02:47:38.521202+0000","last_became_active":"2024-08-17T02:47:38.520967+0000","last_became_peered":"2024-08-17T02:47:38.520967+0000","last_unstale":"2024-08-17T02:47:38.521202+0000","last_undegraded":"2024-08-17T02:47:38.521202+0000","last_fullsized":"2024-08-17T02:47:38.521202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:51.644235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522880+0000","last_change":"2024-08-17T02:47:38.522880+0000","last_active":"2024-08-17T02:47:38.522880+0000","last_peered":"2024-08-17T02:47:38.522880+0000","last_clean":"2024-08-17T02:47:38.522880+0000","last_became_active":"2024-08-17T02:47:38.522502+0000","last_became_peered":"2024-08-17T02:47:38.522502+0000","last_unstale":"2024-08-17T02:47:38.522880+0000","last_undegraded":"2024-08-17T02:47:38.522880+0000","last_fullsized":"2024-08-17T02:47:38.522880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516842+0000","last_change":"2024-08-17T02:47:38.511843+0000","last_active":"2024-08-17T02:47:38.516842+0000","last_peered":"2024-08-17T02:47:38.516842+0000","last_clean":"2024-08-17T02:47:38.516842+0000","last_became_active":"2024-08-17T02:47:38.510859+0000","last_became_peered":"2024-08-17T02:47:38.510859+0000","last_unstale":"2024-08-17T02:47:38.516842+0000","last_undegraded":"2024-08-17T02:47:38.516842+0000","last_fullsized":"2024-08-17T02:47:38.516842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:41:19.411226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521962+0000","last_change":"2024-08-17T02:47:38.513052+0000","last_active":"2024-08-17T02:47:38.521962+0000","last_peered":"2024-08-17T02:47:38.521962+0000","last_clean":"2024-08-17T02:47:38.521962+0000","last_became_active":"2024-08-17T02:47:38.512781+0000","last_became_peered":"2024-08-17T02:47:38.512781+0000","last_unstale":"2024-08-17T02:47:38.521962+0000","last_undegraded":"2024-08-17T02:47:38.521962+0000","last_fullsized":"2024-08-17T02:47:38.521962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:17.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515967+0000","last_change":"2024-08-17T02:47:38.509184+0000","last_active":"2024-08-17T02:47:38.515967+0000","last_peered":"2024-08-17T02:47:38.515967+0000","last_clean":"2024-08-17T02:47:38.515967+0000","last_became_active":"2024-08-17T02:47:38.508920+0000","last_became_peered":"2024-08-17T02:47:38.508920+0000","last_unstale":"2024-08-17T02:47:38.515967+0000","last_undegraded":"2024-08-17T02:47:38.515967+0000","last_fullsized":"2024-08-17T02:47:38.515967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:33.349142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516821+0000","last_change":"2024-08-17T02:47:38.516821+0000","last_active":"2024-08-17T02:47:38.516821+0000","last_peered":"2024-08-17T02:47:38.516821+0000","last_clean":"2024-08-17T02:47:38.516821+0000","last_became_active":"2024-08-17T02:47:38.516556+0000","last_became_peered":"2024-08-17T02:47:38.516556+0000","last_unstale":"2024-08-17T02:47:38.516821+0000","last_undegraded":"2024-08-17T02:47:38.516821+0000","last_fullsized":"2024-08-17T02:47:38.516821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:28:17.981272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518982+0000","last_change":"2024-08-17T02:47:38.518982+0000","last_active":"2024-08-17T02:47:38.518982+0000","last_peered":"2024-08-17T02:47:38.518982+0000","last_clean":"2024-08-17T02:47:38.518982+0000","last_became_active":"2024-08-17T02:47:38.518659+0000","last_became_peered":"2024-08-17T02:47:38.518659+0000","last_unstale":"2024-08-17T02:47:38.518982+0000","last_undegraded":"2024-08-17T02:47:38.518982+0000","last_fullsized":"2024-08-17T02:47:38.518982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:24.329977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513732+0000","last_change":"2024-08-17T02:47:38.509965+0000","last_active":"2024-08-17T02:47:38.513732+0000","last_peered":"2024-08-17T02:47:38.513732+0000","last_clean":"2024-08-17T02:47:38.513732+0000","last_became_active":"2024-08-17T02:47:38.509712+0000","last_became_peered":"2024-08-17T02:47:38.509712+0000","last_unstale":"2024-08-17T02:47:38.513732+0000","last_undegraded":"2024-08-17T02:47:38.513732+0000","last_fullsized":"2024-08-17T02:47:38.513732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:08.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514048+0000","last_change":"2024-08-17T02:47:38.507047+0000","last_active":"2024-08-17T02:47:38.514048+0000","last_peered":"2024-08-17T02:47:38.514048+0000","last_clean":"2024-08-17T02:47:38.514048+0000","last_became_active":"2024-08-17T02:47:38.506754+0000","last_became_peered":"2024-08-17T02:47:38.506754+0000","last_unstale":"2024-08-17T02:47:38.514048+0000","last_undegraded":"2024-08-17T02:47:38.514048+0000","last_fullsized":"2024-08-17T02:47:38.514048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:08.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.526261+0000","last_change":"2024-08-17T02:47:38.524552+0000","last_active":"2024-08-17T02:47:38.526261+0000","last_peered":"2024-08-17T02:47:38.526261+0000","last_clean":"2024-08-17T02:47:38.526261+0000","last_became_active":"2024-08-17T02:47:38.524301+0000","last_became_peered":"2024-08-17T02:47:38.524301+0000","last_unstale":"2024-08-17T02:47:38.526261+0000","last_undegraded":"2024-08-17T02:47:38.526261+0000","last_fullsized":"2024-08-17T02:47:38.526261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:53.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.529532+0000","last_change":"2024-08-17T02:47:38.527666+0000","last_active":"2024-08-17T02:47:38.529532+0000","last_peered":"2024-08-17T02:47:38.529532+0000","last_clean":"2024-08-17T02:47:38.529532+0000","last_became_active":"2024-08-17T02:47:38.527410+0000","last_became_peered":"2024-08-17T02:47:38.527410+0000","last_unstale":"2024-08-17T02:47:38.529532+0000","last_undegraded":"2024-08-17T02:47:38.529532+0000","last_fullsized":"2024-08-17T02:47:38.529532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:38.435688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519031+0000","last_change":"2024-08-17T02:47:38.515317+0000","last_active":"2024-08-17T02:47:38.519031+0000","last_peered":"2024-08-17T02:47:38.519031+0000","last_clean":"2024-08-17T02:47:38.519031+0000","last_became_active":"2024-08-17T02:47:38.514942+0000","last_became_peered":"2024-08-17T02:47:38.514942+0000","last_unstale":"2024-08-17T02:47:38.519031+0000","last_undegraded":"2024-08-17T02:47:38.519031+0000","last_fullsized":"2024-08-17T02:47:38.519031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:53.322044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514301+0000","last_change":"2024-08-17T02:47:38.508267+0000","last_active":"2024-08-17T02:47:38.514301+0000","last_peered":"2024-08-17T02:47:38.514301+0000","last_clean":"2024-08-17T02:47:38.514301+0000","last_became_active":"2024-08-17T02:47:38.508005+0000","last_became_peered":"2024-08-17T02:47:38.508005+0000","last_unstale":"2024-08-17T02:47:38.514301+0000","last_undegraded":"2024-08-17T02:47:38.514301+0000","last_fullsized":"2024-08-17T02:47:38.514301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:55:51.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521083+0000","last_change":"2024-08-17T02:47:38.521083+0000","last_active":"2024-08-17T02:47:38.521083+0000","last_peered":"2024-08-17T02:47:38.521083+0000","last_clean":"2024-08-17T02:47:38.521083+0000","last_became_active":"2024-08-17T02:47:38.520721+0000","last_became_peered":"2024-08-17T02:47:38.520721+0000","last_unstale":"2024-08-17T02:47:38.521083+0000","last_undegraded":"2024-08-17T02:47:38.521083+0000","last_fullsized":"2024-08-17T02:47:38.521083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:55:51.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517951+0000","last_change":"2024-08-17T02:47:38.517951+0000","last_active":"2024-08-17T02:47:38.517951+0000","last_peered":"2024-08-17T02:47:38.517951+0000","last_clean":"2024-08-17T02:47:38.517951+0000","last_became_active":"2024-08-17T02:47:38.517676+0000","last_became_peered":"2024-08-17T02:47:38.517676+0000","last_unstale":"2024-08-17T02:47:38.517951+0000","last_undegraded":"2024-08-17T02:47:38.517951+0000","last_fullsized":"2024-08-17T02:47:38.517951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:33.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518171+0000","last_change":"2024-08-17T02:47:38.518171+0000","last_active":"2024-08-17T02:47:38.518171+0000","last_peered":"2024-08-17T02:47:38.518171+0000","last_clean":"2024-08-17T02:47:38.518171+0000","last_became_active":"2024-08-17T02:47:38.517925+0000","last_became_peered":"2024-08-17T02:47:38.517925+0000","last_unstale":"2024-08-17T02:47:38.518171+0000","last_undegraded":"2024-08-17T02:47:38.518171+0000","last_fullsized":"2024-08-17T02:47:38.518171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:54.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522329+0000","last_change":"2024-08-17T02:47:38.522329+0000","last_active":"2024-08-17T02:47:38.522329+0000","last_peered":"2024-08-17T02:47:38.522329+0000","last_clean":"2024-08-17T02:47:38.522329+0000","last_became_active":"2024-08-17T02:47:38.521592+0000","last_became_peered":"2024-08-17T02:47:38.521592+0000","last_unstale":"2024-08-17T02:47:38.522329+0000","last_undegraded":"2024-08-17T02:47:38.522329+0000","last_fullsized":"2024-08-17T02:47:38.522329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:51.018802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.523033+0000","last_change":"2024-08-17T02:47:38.520982+0000","last_active":"2024-08-17T02:47:38.523033+0000","last_peered":"2024-08-17T02:47:38.523033+0000","last_clean":"2024-08-17T02:47:38.523033+0000","last_became_active":"2024-08-17T02:47:38.517097+0000","last_became_peered":"2024-08-17T02:47:38.517097+0000","last_unstale":"2024-08-17T02:47:38.523033+0000","last_undegraded":"2024-08-17T02:47:38.523033+0000","last_fullsized":"2024-08-17T02:47:38.523033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:48.509277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.533755+0000","last_change":"2024-08-17T02:47:37.498989+0000","last_active":"2024-08-17T02:47:38.533755+0000","last_peered":"2024-08-17T02:47:38.533755+0000","last_clean":"2024-08-17T02:47:38.533755+0000","last_became_active":"2024-08-17T02:47:37.497440+0000","last_became_peered":"2024-08-17T02:47:37.497440+0000","last_unstale":"2024-08-17T02:47:38.533755+0000","last_undegraded":"2024-08-17T02:47:38.533755+0000","last_fullsized":"2024-08-17T02:47:38.533755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:08.668805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.520894+0000","last_change":"2024-08-17T02:47:38.520894+0000","last_active":"2024-08-17T02:47:38.520894+0000","last_peered":"2024-08-17T02:47:38.520894+0000","last_clean":"2024-08-17T02:47:38.520894+0000","last_became_active":"2024-08-17T02:47:38.520576+0000","last_became_peered":"2024-08-17T02:47:38.520576+0000","last_unstale":"2024-08-17T02:47:38.520894+0000","last_undegraded":"2024-08-17T02:47:38.520894+0000","last_fullsized":"2024-08-17T02:47:38.520894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:15.899589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.530765+0000","last_change":"2024-08-17T02:47:37.499031+0000","last_active":"2024-08-17T02:47:38.530765+0000","last_peered":"2024-08-17T02:47:38.530765+0000","last_clean":"2024-08-17T02:47:38.530765+0000","last_became_active":"2024-08-17T02:47:37.498755+0000","last_became_peered":"2024-08-17T02:47:37.498755+0000","last_unstale":"2024-08-17T02:47:38.530765+0000","last_undegraded":"2024-08-17T02:47:38.530765+0000","last_fullsized":"2024-08-17T02:47:38.530765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:33.759302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517937+0000","last_change":"2024-08-17T02:47:38.517937+0000","last_active":"2024-08-17T02:47:38.517937+0000","last_peered":"2024-08-17T02:47:38.517937+0000","last_clean":"2024-08-17T02:47:38.517937+0000","last_became_active":"2024-08-17T02:47:38.517633+0000","last_became_peered":"2024-08-17T02:47:38.517633+0000","last_unstale":"2024-08-17T02:47:38.517937+0000","last_undegraded":"2024-08-17T02:47:38.517937+0000","last_fullsized":"2024-08-17T02:47:38.517937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.531915+0000","last_change":"2024-08-17T02:47:37.504307+0000","last_active":"2024-08-17T02:47:38.531915+0000","last_peered":"2024-08-17T02:47:38.531915+0000","last_clean":"2024-08-17T02:47:38.531915+0000","last_became_active":"2024-08-17T02:47:37.503822+0000","last_became_peered":"2024-08-17T02:47:37.503822+0000","last_unstale":"2024-08-17T02:47:38.531915+0000","last_undegraded":"2024-08-17T02:47:38.531915+0000","last_fullsized":"2024-08-17T02:47:38.531915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:41:59.428407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518986+0000","last_change":"2024-08-17T02:47:38.515173+0000","last_active":"2024-08-17T02:47:38.518986+0000","last_peered":"2024-08-17T02:47:38.518986+0000","last_clean":"2024-08-17T02:47:38.518986+0000","last_became_active":"2024-08-17T02:47:38.514616+0000","last_became_peered":"2024-08-17T02:47:38.514616+0000","last_unstale":"2024-08-17T02:47:38.518986+0000","last_undegraded":"2024-08-17T02:47:38.518986+0000","last_fullsized":"2024-08-17T02:47:38.518986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:44.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.525998+0000","last_change":"2024-08-17T02:47:37.502211+0000","last_active":"2024-08-17T02:47:38.525998+0000","last_peered":"2024-08-17T02:47:38.525998+0000","last_clean":"2024-08-17T02:47:38.525998+0000","last_became_active":"2024-08-17T02:47:37.501926+0000","last_became_peered":"2024-08-17T02:47:37.501926+0000","last_unstale":"2024-08-17T02:47:38.525998+0000","last_undegraded":"2024-08-17T02:47:38.525998+0000","last_fullsized":"2024-08-17T02:47:38.525998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:17:45.437240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522062+0000","last_change":"2024-08-17T02:47:38.522062+0000","last_active":"2024-08-17T02:47:38.522062+0000","last_peered":"2024-08-17T02:47:38.522062+0000","last_clean":"2024-08-17T02:47:38.522062+0000","last_became_active":"2024-08-17T02:47:38.521713+0000","last_became_peered":"2024-08-17T02:47:38.521713+0000","last_unstale":"2024-08-17T02:47:38.522062+0000","last_undegraded":"2024-08-17T02:47:38.522062+0000","last_fullsized":"2024-08-17T02:47:38.522062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:48.509277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.500583+0000","last_change":"2024-08-17T02:47:37.509581+0000","last_active":"2024-08-17T02:47:38.500583+0000","last_peered":"2024-08-17T02:47:38.500583+0000","last_clean":"2024-08-17T02:47:38.500583+0000","last_became_active":"2024-08-17T02:47:37.508769+0000","last_became_peered":"2024-08-17T02:47:37.508769+0000","last_unstale":"2024-08-17T02:47:38.500583+0000","last_undegraded":"2024-08-17T02:47:38.500583+0000","last_fullsized":"2024-08-17T02:47:38.500583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:19.752313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521912+0000","last_change":"2024-08-17T02:47:38.512388+0000","last_active":"2024-08-17T02:47:38.521912+0000","last_peered":"2024-08-17T02:47:38.521912+0000","last_clean":"2024-08-17T02:47:38.521912+0000","last_became_active":"2024-08-17T02:47:38.512054+0000","last_became_peered":"2024-08-17T02:47:38.512054+0000","last_unstale":"2024-08-17T02:47:38.521912+0000","last_undegraded":"2024-08-17T02:47:38.521912+0000","last_fullsized":"2024-08-17T02:47:38.521912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.501417+0000","last_change":"2024-08-17T02:47:37.509353+0000","last_active":"2024-08-17T02:47:38.501417+0000","last_peered":"2024-08-17T02:47:38.501417+0000","last_clean":"2024-08-17T02:47:38.501417+0000","last_became_active":"2024-08-17T02:47:37.508776+0000","last_became_peered":"2024-08-17T02:47:37.508776+0000","last_unstale":"2024-08-17T02:47:38.501417+0000","last_undegraded":"2024-08-17T02:47:38.501417+0000","last_fullsized":"2024-08-17T02:47:38.501417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:33:12.989420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.518171+0000","last_change":"2024-08-17T02:47:38.518171+0000","last_active":"2024-08-17T02:47:38.518171+0000","last_peered":"2024-08-17T02:47:38.518171+0000","last_clean":"2024-08-17T02:47:38.518171+0000","last_became_active":"2024-08-17T02:47:38.517499+0000","last_became_peered":"2024-08-17T02:47:38.517499+0000","last_unstale":"2024-08-17T02:47:38.518171+0000","last_undegraded":"2024-08-17T02:47:38.518171+0000","last_fullsized":"2024-08-17T02:47:38.518171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:07:14.982848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503938+0000","last_change":"2024-08-17T02:47:37.500902+0000","last_active":"2024-08-17T02:47:38.503938+0000","last_peered":"2024-08-17T02:47:38.503938+0000","last_clean":"2024-08-17T02:47:38.503938+0000","last_became_active":"2024-08-17T02:47:37.500617+0000","last_became_peered":"2024-08-17T02:47:37.500617+0000","last_unstale":"2024-08-17T02:47:38.503938+0000","last_undegraded":"2024-08-17T02:47:38.503938+0000","last_fullsized":"2024-08-17T02:47:38.503938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:32.342661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.514183+0000","last_change":"2024-08-17T02:47:38.512527+0000","last_active":"2024-08-17T02:47:38.514183+0000","last_peered":"2024-08-17T02:47:38.514183+0000","last_clean":"2024-08-17T02:47:38.514183+0000","last_became_active":"2024-08-17T02:47:38.512289+0000","last_became_peered":"2024-08-17T02:47:38.512289+0000","last_unstale":"2024-08-17T02:47:38.514183+0000","last_undegraded":"2024-08-17T02:47:38.514183+0000","last_fullsized":"2024-08-17T02:47:38.514183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:00.434889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.502244+0000","last_change":"2024-08-17T02:47:37.495694+0000","last_active":"2024-08-17T02:47:37.502244+0000","last_peered":"2024-08-17T02:47:37.502244+0000","last_clean":"2024-08-17T02:47:37.502244+0000","last_became_active":"2024-08-17T02:47:37.495435+0000","last_became_peered":"2024-08-17T02:47:37.495435+0000","last_unstale":"2024-08-17T02:47:37.502244+0000","last_undegraded":"2024-08-17T02:47:37.502244+0000","last_fullsized":"2024-08-17T02:47:37.502244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:32:35.671408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.527509+0000","last_change":"2024-08-17T02:47:38.518285+0000","last_active":"2024-08-17T02:47:38.527509+0000","last_peered":"2024-08-17T02:47:38.527509+0000","last_clean":"2024-08-17T02:47:38.527509+0000","last_became_active":"2024-08-17T02:47:38.518063+0000","last_became_peered":"2024-08-17T02:47:38.518063+0000","last_unstale":"2024-08-17T02:47:38.527509+0000","last_undegraded":"2024-08-17T02:47:38.527509+0000","last_fullsized":"2024-08-17T02:47:38.527509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:23.733775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.502774+0000","last_change":"2024-08-17T02:47:37.506239+0000","last_active":"2024-08-17T02:47:38.502774+0000","last_peered":"2024-08-17T02:47:38.502774+0000","last_clean":"2024-08-17T02:47:38.502774+0000","last_became_active":"2024-08-17T02:47:37.505989+0000","last_became_peered":"2024-08-17T02:47:37.505989+0000","last_unstale":"2024-08-17T02:47:38.502774+0000","last_undegraded":"2024-08-17T02:47:38.502774+0000","last_fullsized":"2024-08-17T02:47:38.502774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:47:01.082107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517413+0000","last_change":"2024-08-17T02:47:38.511054+0000","last_active":"2024-08-17T02:47:38.517413+0000","last_peered":"2024-08-17T02:47:38.517413+0000","last_clean":"2024-08-17T02:47:38.517413+0000","last_became_active":"2024-08-17T02:47:38.510817+0000","last_became_peered":"2024-08-17T02:47:38.510817+0000","last_unstale":"2024-08-17T02:47:38.517413+0000","last_undegraded":"2024-08-17T02:47:38.517413+0000","last_fullsized":"2024-08-17T02:47:38.517413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:57.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503629+0000","last_change":"2024-08-17T02:47:37.500291+0000","last_active":"2024-08-17T02:47:38.503629+0000","last_peered":"2024-08-17T02:47:38.503629+0000","last_clean":"2024-08-17T02:47:38.503629+0000","last_became_active":"2024-08-17T02:47:37.500058+0000","last_became_peered":"2024-08-17T02:47:37.500058+0000","last_unstale":"2024-08-17T02:47:38.503629+0000","last_undegraded":"2024-08-17T02:47:38.503629+0000","last_fullsized":"2024-08-17T02:47:38.503629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:09.327150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.523881+0000","last_change":"2024-08-17T02:47:38.521455+0000","last_active":"2024-08-17T02:47:38.523881+0000","last_peered":"2024-08-17T02:47:38.523881+0000","last_clean":"2024-08-17T02:47:38.523881+0000","last_became_active":"2024-08-17T02:47:38.519445+0000","last_became_peered":"2024-08-17T02:47:38.519445+0000","last_unstale":"2024-08-17T02:47:38.523881+0000","last_undegraded":"2024-08-17T02:47:38.523881+0000","last_fullsized":"2024-08-17T02:47:38.523881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:15.901785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.531475+0000","last_change":"2024-08-17T02:47:37.503379+0000","last_active":"2024-08-17T02:47:38.531475+0000","last_peered":"2024-08-17T02:47:38.531475+0000","last_clean":"2024-08-17T02:47:38.531475+0000","last_became_active":"2024-08-17T02:47:37.503140+0000","last_became_peered":"2024-08-17T02:47:37.503140+0000","last_unstale":"2024-08-17T02:47:38.531475+0000","last_undegraded":"2024-08-17T02:47:38.531475+0000","last_fullsized":"2024-08-17T02:47:38.531475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:36.168296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515765+0000","last_change":"2024-08-17T02:47:38.509599+0000","last_active":"2024-08-17T02:47:38.515765+0000","last_peered":"2024-08-17T02:47:38.515765+0000","last_clean":"2024-08-17T02:47:38.515765+0000","last_became_active":"2024-08-17T02:47:38.509205+0000","last_became_peered":"2024-08-17T02:47:38.509205+0000","last_unstale":"2024-08-17T02:47:38.515765+0000","last_undegraded":"2024-08-17T02:47:38.515765+0000","last_fullsized":"2024-08-17T02:47:38.515765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:26.063659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.536091+0000","last_change":"2024-08-17T02:47:37.507701+0000","last_active":"2024-08-17T02:47:38.536091+0000","last_peered":"2024-08-17T02:47:38.536091+0000","last_clean":"2024-08-17T02:47:38.536091+0000","last_became_active":"2024-08-17T02:47:37.507469+0000","last_became_peered":"2024-08-17T02:47:37.507469+0000","last_unstale":"2024-08-17T02:47:38.536091+0000","last_undegraded":"2024-08-17T02:47:38.536091+0000","last_fullsized":"2024-08-17T02:47:38.536091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:53.258054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513591+0000","last_change":"2024-08-17T02:47:38.512232+0000","last_active":"2024-08-17T02:47:38.513591+0000","last_peered":"2024-08-17T02:47:38.513591+0000","last_clean":"2024-08-17T02:47:38.513591+0000","last_became_active":"2024-08-17T02:47:38.511942+0000","last_became_peered":"2024-08-17T02:47:38.511942+0000","last_unstale":"2024-08-17T02:47:38.513591+0000","last_undegraded":"2024-08-17T02:47:38.513591+0000","last_fullsized":"2024-08-17T02:47:38.513591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:32:22.769124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.534173+0000","last_change":"2024-08-17T02:47:37.502360+0000","last_active":"2024-08-17T02:47:38.534173+0000","last_peered":"2024-08-17T02:47:38.534173+0000","last_clean":"2024-08-17T02:47:38.534173+0000","last_became_active":"2024-08-17T02:47:37.502063+0000","last_became_peered":"2024-08-17T02:47:37.502063+0000","last_unstale":"2024-08-17T02:47:38.534173+0000","last_undegraded":"2024-08-17T02:47:38.534173+0000","last_fullsized":"2024-08-17T02:47:38.534173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:08.668805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516749+0000","last_change":"2024-08-17T02:47:38.510004+0000","last_active":"2024-08-17T02:47:38.516749+0000","last_peered":"2024-08-17T02:47:38.516749+0000","last_clean":"2024-08-17T02:47:38.516749+0000","last_became_active":"2024-08-17T02:47:38.509551+0000","last_became_peered":"2024-08-17T02:47:38.509551+0000","last_unstale":"2024-08-17T02:47:38.516749+0000","last_undegraded":"2024-08-17T02:47:38.516749+0000","last_fullsized":"2024-08-17T02:47:38.516749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:41.221396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.493993+0000","last_change":"2024-08-17T02:47:37.495698+0000","last_active":"2024-08-17T02:47:38.493993+0000","last_peered":"2024-08-17T02:47:38.493993+0000","last_clean":"2024-08-17T02:47:38.493993+0000","last_became_active":"2024-08-17T02:47:37.495461+0000","last_became_peered":"2024-08-17T02:47:37.495461+0000","last_unstale":"2024-08-17T02:47:38.493993+0000","last_undegraded":"2024-08-17T02:47:38.493993+0000","last_fullsized":"2024-08-17T02:47:38.493993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:32.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522508+0000","last_change":"2024-08-17T02:47:38.522508+0000","last_active":"2024-08-17T02:47:38.522508+0000","last_peered":"2024-08-17T02:47:38.522508+0000","last_clean":"2024-08-17T02:47:38.522508+0000","last_became_active":"2024-08-17T02:47:38.522072+0000","last_became_peered":"2024-08-17T02:47:38.522072+0000","last_unstale":"2024-08-17T02:47:38.522508+0000","last_undegraded":"2024-08-17T02:47:38.522508+0000","last_fullsized":"2024-08-17T02:47:38.522508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:31.699154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.508941+0000","last_change":"2024-08-17T02:47:37.507198+0000","last_active":"2024-08-17T02:47:38.508941+0000","last_peered":"2024-08-17T02:47:38.508941+0000","last_clean":"2024-08-17T02:47:38.508941+0000","last_became_active":"2024-08-17T02:47:37.506925+0000","last_became_peered":"2024-08-17T02:47:37.506925+0000","last_unstale":"2024-08-17T02:47:38.508941+0000","last_undegraded":"2024-08-17T02:47:38.508941+0000","last_fullsized":"2024-08-17T02:47:38.508941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:48.420405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.520895+0000","last_change":"2024-08-17T02:47:38.520895+0000","last_active":"2024-08-17T02:47:38.520895+0000","last_peered":"2024-08-17T02:47:38.520895+0000","last_clean":"2024-08-17T02:47:38.520895+0000","last_became_active":"2024-08-17T02:47:38.520651+0000","last_became_peered":"2024-08-17T02:47:38.520651+0000","last_unstale":"2024-08-17T02:47:38.520895+0000","last_undegraded":"2024-08-17T02:47:38.520895+0000","last_fullsized":"2024-08-17T02:47:38.520895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:10.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.534621+0000","last_change":"2024-08-17T02:47:37.505221+0000","last_active":"2024-08-17T02:47:38.534621+0000","last_peered":"2024-08-17T02:47:38.534621+0000","last_clean":"2024-08-17T02:47:38.534621+0000","last_became_active":"2024-08-17T02:47:37.504914+0000","last_became_peered":"2024-08-17T02:47:37.504914+0000","last_unstale":"2024-08-17T02:47:38.534621+0000","last_undegraded":"2024-08-17T02:47:38.534621+0000","last_fullsized":"2024-08-17T02:47:38.534621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:57.611241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515349+0000","last_change":"2024-08-17T02:47:38.515349+0000","last_active":"2024-08-17T02:47:38.515349+0000","last_peered":"2024-08-17T02:47:38.515349+0000","last_clean":"2024-08-17T02:47:38.515349+0000","last_became_active":"2024-08-17T02:47:38.515100+0000","last_became_peered":"2024-08-17T02:47:38.515100+0000","last_unstale":"2024-08-17T02:47:38.515349+0000","last_undegraded":"2024-08-17T02:47:38.515349+0000","last_fullsized":"2024-08-17T02:47:38.515349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:16.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.525494+0000","last_change":"2024-08-17T02:47:37.509117+0000","last_active":"2024-08-17T02:47:38.525494+0000","last_peered":"2024-08-17T02:47:38.525494+0000","last_clean":"2024-08-17T02:47:38.525494+0000","last_became_active":"2024-08-17T02:47:37.508702+0000","last_became_peered":"2024-08-17T02:47:37.508702+0000","last_unstale":"2024-08-17T02:47:38.525494+0000","last_undegraded":"2024-08-17T02:47:38.525494+0000","last_fullsized":"2024-08-17T02:47:38.525494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:55.911111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.528101+0000","last_change":"2024-08-17T02:47:38.519855+0000","last_active":"2024-08-17T02:47:38.528101+0000","last_peered":"2024-08-17T02:47:38.528101+0000","last_clean":"2024-08-17T02:47:38.528101+0000","last_became_active":"2024-08-17T02:47:38.519194+0000","last_became_peered":"2024-08-17T02:47:38.519194+0000","last_unstale":"2024-08-17T02:47:38.528101+0000","last_undegraded":"2024-08-17T02:47:38.528101+0000","last_fullsized":"2024-08-17T02:47:38.528101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:15.123760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.534192+0000","last_change":"2024-08-17T02:47:37.501645+0000","last_active":"2024-08-17T02:47:38.534192+0000","last_peered":"2024-08-17T02:47:38.534192+0000","last_clean":"2024-08-17T02:47:38.534192+0000","last_became_active":"2024-08-17T02:47:37.501400+0000","last_became_peered":"2024-08-17T02:47:37.501400+0000","last_unstale":"2024-08-17T02:47:38.534192+0000","last_undegraded":"2024-08-17T02:47:38.534192+0000","last_fullsized":"2024-08-17T02:47:38.534192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:29:09.183917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519877+0000","last_change":"2024-08-17T02:47:38.518068+0000","last_active":"2024-08-17T02:47:38.519877+0000","last_peered":"2024-08-17T02:47:38.519877+0000","last_clean":"2024-08-17T02:47:38.519877+0000","last_became_active":"2024-08-17T02:47:38.517521+0000","last_became_peered":"2024-08-17T02:47:38.517521+0000","last_unstale":"2024-08-17T02:47:38.519877+0000","last_undegraded":"2024-08-17T02:47:38.519877+0000","last_fullsized":"2024-08-17T02:47:38.519877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:55.156017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503209+0000","last_change":"2024-08-17T02:47:37.500643+0000","last_active":"2024-08-17T02:47:38.503209+0000","last_peered":"2024-08-17T02:47:38.503209+0000","last_clean":"2024-08-17T02:47:38.503209+0000","last_became_active":"2024-08-17T02:47:37.500376+0000","last_became_peered":"2024-08-17T02:47:37.500376+0000","last_unstale":"2024-08-17T02:47:38.503209+0000","last_undegraded":"2024-08-17T02:47:38.503209+0000","last_fullsized":"2024-08-17T02:47:38.503209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:51:53.607024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.521844+0000","last_change":"2024-08-17T02:47:38.516532+0000","last_active":"2024-08-17T02:47:38.521844+0000","last_peered":"2024-08-17T02:47:38.521844+0000","last_clean":"2024-08-17T02:47:38.521844+0000","last_became_active":"2024-08-17T02:47:38.516214+0000","last_became_peered":"2024-08-17T02:47:38.516214+0000","last_unstale":"2024-08-17T02:47:38.521844+0000","last_undegraded":"2024-08-17T02:47:38.521844+0000","last_fullsized":"2024-08-17T02:47:38.521844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:32:22.769124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.510635+0000","last_change":"2024-08-17T02:47:37.509149+0000","last_active":"2024-08-17T02:47:37.510635+0000","last_peered":"2024-08-17T02:47:37.510635+0000","last_clean":"2024-08-17T02:47:37.510635+0000","last_became_active":"2024-08-17T02:47:37.508801+0000","last_became_peered":"2024-08-17T02:47:37.508801+0000","last_unstale":"2024-08-17T02:47:37.510635+0000","last_undegraded":"2024-08-17T02:47:37.510635+0000","last_fullsized":"2024-08-17T02:47:37.510635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:30.833450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517346+0000","last_change":"2024-08-17T02:47:38.514652+0000","last_active":"2024-08-17T02:47:38.517346+0000","last_peered":"2024-08-17T02:47:38.517346+0000","last_clean":"2024-08-17T02:47:38.517346+0000","last_became_active":"2024-08-17T02:47:38.513618+0000","last_became_peered":"2024-08-17T02:47:38.513618+0000","last_unstale":"2024-08-17T02:47:38.517346+0000","last_undegraded":"2024-08-17T02:47:38.517346+0000","last_fullsized":"2024-08-17T02:47:38.517346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:42:00.434889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.528757+0000","last_change":"2024-08-17T02:47:37.497844+0000","last_active":"2024-08-17T02:47:38.528757+0000","last_peered":"2024-08-17T02:47:38.528757+0000","last_clean":"2024-08-17T02:47:38.528757+0000","last_became_active":"2024-08-17T02:47:37.495785+0000","last_became_peered":"2024-08-17T02:47:37.495785+0000","last_unstale":"2024-08-17T02:47:38.528757+0000","last_undegraded":"2024-08-17T02:47:38.528757+0000","last_fullsized":"2024-08-17T02:47:38.528757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:19.774557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516155+0000","last_change":"2024-08-17T02:47:38.509823+0000","last_active":"2024-08-17T02:47:38.516155+0000","last_peered":"2024-08-17T02:47:38.516155+0000","last_clean":"2024-08-17T02:47:38.516155+0000","last_became_active":"2024-08-17T02:47:38.509588+0000","last_became_peered":"2024-08-17T02:47:38.509588+0000","last_unstale":"2024-08-17T02:47:38.516155+0000","last_undegraded":"2024-08-17T02:47:38.516155+0000","last_fullsized":"2024-08-17T02:47:38.516155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:47:02.088588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.505330+0000","last_change":"2024-08-17T02:47:37.501371+0000","last_active":"2024-08-17T02:47:37.505330+0000","last_peered":"2024-08-17T02:47:37.505330+0000","last_clean":"2024-08-17T02:47:37.505330+0000","last_became_active":"2024-08-17T02:47:37.501127+0000","last_became_peered":"2024-08-17T02:47:37.501127+0000","last_unstale":"2024-08-17T02:47:37.505330+0000","last_undegraded":"2024-08-17T02:47:37.505330+0000","last_fullsized":"2024-08-17T02:47:37.505330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:03.700538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.508486+0000","last_change":"2024-08-17T02:47:38.505804+0000","last_active":"2024-08-17T02:47:38.508486+0000","last_peered":"2024-08-17T02:47:38.508486+0000","last_clean":"2024-08-17T02:47:38.508486+0000","last_became_active":"2024-08-17T02:47:38.504775+0000","last_became_peered":"2024-08-17T02:47:38.504775+0000","last_unstale":"2024-08-17T02:47:38.508486+0000","last_undegraded":"2024-08-17T02:47:38.508486+0000","last_fullsized":"2024-08-17T02:47:38.508486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:49.426886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.508371+0000","last_change":"2024-08-17T02:47:37.505465+0000","last_active":"2024-08-17T02:47:37.508371+0000","last_peered":"2024-08-17T02:47:37.508371+0000","last_clean":"2024-08-17T02:47:37.508371+0000","last_became_active":"2024-08-17T02:47:37.504868+0000","last_became_peered":"2024-08-17T02:47:37.504868+0000","last_unstale":"2024-08-17T02:47:37.508371+0000","last_undegraded":"2024-08-17T02:47:37.508371+0000","last_fullsized":"2024-08-17T02:47:37.508371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:13.378723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.524440+0000","last_change":"2024-08-17T02:47:38.524440+0000","last_active":"2024-08-17T02:47:38.524440+0000","last_peered":"2024-08-17T02:47:38.524440+0000","last_clean":"2024-08-17T02:47:38.524440+0000","last_became_active":"2024-08-17T02:47:38.524160+0000","last_became_peered":"2024-08-17T02:47:38.524160+0000","last_unstale":"2024-08-17T02:47:38.524440+0000","last_undegraded":"2024-08-17T02:47:38.524440+0000","last_fullsized":"2024-08-17T02:47:38.524440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:15.123760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.499018+0000","last_change":"2024-08-17T02:47:37.507914+0000","last_active":"2024-08-17T02:47:38.499018+0000","last_peered":"2024-08-17T02:47:38.499018+0000","last_clean":"2024-08-17T02:47:38.499018+0000","last_became_active":"2024-08-17T02:47:37.507518+0000","last_became_peered":"2024-08-17T02:47:37.507518+0000","last_unstale":"2024-08-17T02:47:38.499018+0000","last_undegraded":"2024-08-17T02:47:38.499018+0000","last_fullsized":"2024-08-17T02:47:38.499018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:53.201527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.516899+0000","last_change":"2024-08-17T02:47:38.510024+0000","last_active":"2024-08-17T02:47:38.516899+0000","last_peered":"2024-08-17T02:47:38.516899+0000","last_clean":"2024-08-17T02:47:38.516899+0000","last_became_active":"2024-08-17T02:47:38.509759+0000","last_became_peered":"2024-08-17T02:47:38.509759+0000","last_unstale":"2024-08-17T02:47:38.516899+0000","last_undegraded":"2024-08-17T02:47:38.516899+0000","last_fullsized":"2024-08-17T02:47:38.516899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.617723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.529637+0000","last_change":"2024-08-17T02:47:37.500921+0000","last_active":"2024-08-17T02:47:38.529637+0000","last_peered":"2024-08-17T02:47:38.529637+0000","last_clean":"2024-08-17T02:47:38.529637+0000","last_became_active":"2024-08-17T02:47:37.500587+0000","last_became_peered":"2024-08-17T02:47:37.500587+0000","last_unstale":"2024-08-17T02:47:38.529637+0000","last_undegraded":"2024-08-17T02:47:38.529637+0000","last_fullsized":"2024-08-17T02:47:38.529637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:52.343413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.519937+0000","last_change":"2024-08-17T02:47:38.510712+0000","last_active":"2024-08-17T02:47:38.519937+0000","last_peered":"2024-08-17T02:47:38.519937+0000","last_clean":"2024-08-17T02:47:38.519937+0000","last_became_active":"2024-08-17T02:47:38.507397+0000","last_became_peered":"2024-08-17T02:47:38.507397+0000","last_unstale":"2024-08-17T02:47:38.519937+0000","last_undegraded":"2024-08-17T02:47:38.519937+0000","last_fullsized":"2024-08-17T02:47:38.519937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:31.699154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503714+0000","last_change":"2024-08-17T02:47:37.497714+0000","last_active":"2024-08-17T02:47:38.503714+0000","last_peered":"2024-08-17T02:47:38.503714+0000","last_clean":"2024-08-17T02:47:38.503714+0000","last_became_active":"2024-08-17T02:47:37.497480+0000","last_became_peered":"2024-08-17T02:47:37.497480+0000","last_unstale":"2024-08-17T02:47:38.503714+0000","last_undegraded":"2024-08-17T02:47:38.503714+0000","last_fullsized":"2024-08-17T02:47:38.503714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.893107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.507394+0000","last_change":"2024-08-17T02:47:38.505533+0000","last_active":"2024-08-17T02:47:38.507394+0000","last_peered":"2024-08-17T02:47:38.507394+0000","last_clean":"2024-08-17T02:47:38.507394+0000","last_became_active":"2024-08-17T02:47:38.505257+0000","last_became_peered":"2024-08-17T02:47:38.505257+0000","last_unstale":"2024-08-17T02:47:38.507394+0000","last_undegraded":"2024-08-17T02:47:38.507394+0000","last_fullsized":"2024-08-17T02:47:38.507394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.593185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.494774+0000","last_change":"2024-08-17T02:47:37.503519+0000","last_active":"2024-08-17T02:47:38.494774+0000","last_peered":"2024-08-17T02:47:38.494774+0000","last_clean":"2024-08-17T02:47:38.494774+0000","last_became_active":"2024-08-17T02:47:37.503262+0000","last_became_peered":"2024-08-17T02:47:37.503262+0000","last_unstale":"2024-08-17T02:47:38.494774+0000","last_undegraded":"2024-08-17T02:47:38.494774+0000","last_fullsized":"2024-08-17T02:47:38.494774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:12.341091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.515241+0000","last_change":"2024-08-17T02:47:38.515241+0000","last_active":"2024-08-17T02:47:38.515241+0000","last_peered":"2024-08-17T02:47:38.515241+0000","last_clean":"2024-08-17T02:47:38.515241+0000","last_became_active":"2024-08-17T02:47:38.514959+0000","last_became_peered":"2024-08-17T02:47:38.514959+0000","last_unstale":"2024-08-17T02:47:38.515241+0000","last_undegraded":"2024-08-17T02:47:38.515241+0000","last_fullsized":"2024-08-17T02:47:38.515241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:34.765783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.502774+0000","last_change":"2024-08-17T02:47:37.489743+0000","last_active":"2024-08-17T02:47:38.502774+0000","last_peered":"2024-08-17T02:47:38.502774+0000","last_clean":"2024-08-17T02:47:38.502774+0000","last_became_active":"2024-08-17T02:47:37.489314+0000","last_became_peered":"2024-08-17T02:47:37.489314+0000","last_unstale":"2024-08-17T02:47:38.502774+0000","last_undegraded":"2024-08-17T02:47:38.502774+0000","last_fullsized":"2024-08-17T02:47:38.502774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:53.201527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.522966+0000","last_change":"2024-08-17T02:47:38.518397+0000","last_active":"2024-08-17T02:47:38.522966+0000","last_peered":"2024-08-17T02:47:38.522966+0000","last_clean":"2024-08-17T02:47:38.522966+0000","last_became_active":"2024-08-17T02:47:38.518168+0000","last_became_peered":"2024-08-17T02:47:38.518168+0000","last_unstale":"2024-08-17T02:47:38.522966+0000","last_undegraded":"2024-08-17T02:47:38.522966+0000","last_fullsized":"2024-08-17T02:47:38.522966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:24.329977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.494089+0000","last_change":"2024-08-17T02:47:37.501022+0000","last_active":"2024-08-17T02:47:38.494089+0000","last_peered":"2024-08-17T02:47:38.494089+0000","last_clean":"2024-08-17T02:47:38.494089+0000","last_became_active":"2024-08-17T02:47:37.500754+0000","last_became_peered":"2024-08-17T02:47:37.500754+0000","last_unstale":"2024-08-17T02:47:38.494089+0000","last_undegraded":"2024-08-17T02:47:38.494089+0000","last_fullsized":"2024-08-17T02:47:38.494089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:19:32.899700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.517188+0000","last_change":"2024-08-17T02:47:38.515576+0000","last_active":"2024-08-17T02:47:38.517188+0000","last_peered":"2024-08-17T02:47:38.517188+0000","last_clean":"2024-08-17T02:47:38.517188+0000","last_became_active":"2024-08-17T02:47:38.514090+0000","last_became_peered":"2024-08-17T02:47:38.514090+0000","last_unstale":"2024-08-17T02:47:38.517188+0000","last_undegraded":"2024-08-17T02:47:38.517188+0000","last_fullsized":"2024-08-17T02:47:38.517188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:38.159312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.502269+0000","last_change":"2024-08-17T02:47:37.497826+0000","last_active":"2024-08-17T02:47:37.502269+0000","last_peered":"2024-08-17T02:47:37.502269+0000","last_clean":"2024-08-17T02:47:37.502269+0000","last_became_active":"2024-08-17T02:47:37.497531+0000","last_became_peered":"2024-08-17T02:47:37.497531+0000","last_unstale":"2024-08-17T02:47:37.502269+0000","last_undegraded":"2024-08-17T02:47:37.502269+0000","last_fullsized":"2024-08-17T02:47:37.502269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:03.700538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.520331+0000","last_change":"2024-08-17T02:47:38.520331+0000","last_active":"2024-08-17T02:47:38.520331+0000","last_peered":"2024-08-17T02:47:38.520331+0000","last_clean":"2024-08-17T02:47:38.520331+0000","last_became_active":"2024-08-17T02:47:38.520018+0000","last_became_peered":"2024-08-17T02:47:38.520018+0000","last_unstale":"2024-08-17T02:47:38.520331+0000","last_undegraded":"2024-08-17T02:47:38.520331+0000","last_fullsized":"2024-08-17T02:47:38.520331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:31.856692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.503644+0000","last_change":"2024-08-17T02:47:37.507656+0000","last_active":"2024-08-17T02:47:38.503644+0000","last_peered":"2024-08-17T02:47:38.503644+0000","last_clean":"2024-08-17T02:47:38.503644+0000","last_became_active":"2024-08-17T02:47:37.507362+0000","last_became_peered":"2024-08-17T02:47:37.507362+0000","last_unstale":"2024-08-17T02:47:38.503644+0000","last_undegraded":"2024-08-17T02:47:38.503644+0000","last_fullsized":"2024-08-17T02:47:38.503644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:31:51.924232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:47:38.513049+0000","last_change":"2024-08-17T02:47:38.513049+0000","last_active":"2024-08-17T02:47:38.513049+0000","last_peered":"2024-08-17T02:47:38.513049+0000","last_clean":"2024-08-17T02:47:38.513049+0000","last_became_active":"2024-08-17T02:47:38.512760+0000","last_became_peered":"2024-08-17T02:47:38.512760+0000","last_unstale":"2024-08-17T02:47:38.513049+0000","last_undegraded":"2024-08-17T02:47:38.513049+0000","last_fullsized":"2024-08-17T02:47:38.513049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:37.475406+0000","last_clean_scrub_stamp":"2024-08-17T02:47:37.475406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:16.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.505770+0000","last_change":"2024-08-17T02:47:37.502613+0000","last_active":"2024-08-17T02:47:37.505770+0000","last_peered":"2024-08-17T02:47:37.505770+0000","last_clean":"2024-08-17T02:47:37.505770+0000","last_became_active":"2024-08-17T02:47:37.502393+0000","last_became_peered":"2024-08-17T02:47:37.502393+0000","last_unstale":"2024-08-17T02:47:37.505770+0000","last_undegraded":"2024-08-17T02:47:37.505770+0000","last_fullsized":"2024-08-17T02:47:37.505770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:36.468925+0000","last_clean_scrub_stamp":"2024-08-17T02:47:36.468925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:13.378723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:37.503380+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:47:37.503380+0000","last_peered":"2024-08-17T02:47:37.503380+0000","last_clean":"2024-08-17T02:47:37.503380+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:47:37.503380+0000","last_undegraded":"2024-08-17T02:47:37.503380+0000","last_fullsized":"2024-08-17T02:47:37.503380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":962560,"data_stored":730133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.79600000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.871},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.76600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":372736,"data_stored":140279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.752}]},{"osd":1,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.59299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67900000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":385024,"data_stored":146623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.629},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.752},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.72799999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":372736,"data_stored":139779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.629}]},{"osd":1,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.501},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.46800000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68899999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":393216,"data_stored":147537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.441}]},{"osd":1,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.374},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.67000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":380928,"data_stored":146033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.505},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.80800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.629}]},{"osd":7,"last update":"Sat Aug 17 02:47:36 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.66400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":380928,"data_stored":141249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9169999999999998,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":2.9169999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.7709999999999999,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":4.7709999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":2.274}]},{"osd":3,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":3.653},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.284},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":3.9660000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":4.3120000000000003},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":6.3120000000000003,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":6.3120000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":4.0060000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:47:37 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":9.5500000000000007,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":9.5500000000000007},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":8.7720000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":958464,"data_stored":730043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.495},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.623},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:47:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.749},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:43.068 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:47:43.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:47:43.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.257+0000 7fd8f3200640 1 Processor -- start 2024-08-17T02:47:43.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.257+0000 7fd8f3200640 1 -- start start 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f3200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8f4153440 0x7fd8f40c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f3200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd8f4159140 0x7fd8f40c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f406cdb0 con 0x7fd8f4153070 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f3200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40c5e20 con 0x7fd8f4159140 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f3200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40c9ee0 con 0x7fd8f4153440 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f1e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd8f4153070 0x7fd8f40c97d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57516/0 (socket says 172.21.15.149:57516) 2024-08-17T02:47:43.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f2800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd8f4159140 0x7fd8f40c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.258+0000 7fd8f1e00640 1 -- 172.21.15.149:0/2387823066 learned_addr learned my addr 172.21.15.149:0/2387823066 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:43.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.259+0000 7fd8f1400640 1 --2- 172.21.15.149:0/2387823066 >> v2:172.21.15.161:3300/0 conn(0x7fd8f4153440 0x7fd8f40c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.259+0000 7fd8f2800640 1 -- 172.21.15.149:0/2387823066 >> v2:172.21.15.161:3300/0 conn(0x7fd8f4153440 msgr2=0x7fd8f40c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:43.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.259+0000 7fd8f2800640 1 --2- 172.21.15.149:0/2387823066 >> v2:172.21.15.161:3300/0 conn(0x7fd8f4153440 0x7fd8f40c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.259+0000 7fd8f2800640 1 -- 172.21.15.149:0/2387823066 >> v1:172.21.15.149:6789/0 conn(0x7fd8f4153070 legacy=0x7fd8f40c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.259+0000 7fd8f2800640 1 -- 172.21.15.149:0/2387823066 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4159690 con 0x7fd8f4159140 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.259+0000 7fd8f0a00640 1 -- 172.21.15.149:0/2387823066 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951014928 0 0) 0x7fd8f406cdb0 con 0x7fd8f4153070 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.260+0000 7fd8f2800640 1 --2- 172.21.15.149:0/2387823066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4159140 0x7fd8f40c5460 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd8f406eed0 tx=0x7fd8ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7eff7d23731c856 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.260+0000 7fd8f0a00640 1 -- 172.21.15.149:0/2387823066 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec007550 con 0x7fd8f4159140 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.260+0000 7fd8f0a00640 1 -- 172.21.15.149:0/2387823066 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec02d050 con 0x7fd8f4159140 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.260+0000 7fd8f0a00640 1 -- 172.21.15.149:0/2387823066 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0078e0 con 0x7fd8f4159140 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 -- 172.21.15.149:0/2387823066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4159140 msgr2=0x7fd8f40c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2387823066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4159140 0x7fd8f40c5460 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd8f406eed0 tx=0x7fd8ec009780 comp rx=0 tx=0).stop 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 -- 172.21.15.149:0/2387823066 shutdown_connections 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2387823066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4159140 0x7fd8f40c5460 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2387823066 >> v2:172.21.15.161:3300/0 conn(0x7fd8f4153440 0x7fd8f40c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 -- 172.21.15.149:0/2387823066 >> 172.21.15.149:0/2387823066 conn(0x7fd8f40cbc00 msgr2=0x7fd8f40cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 -- 172.21.15.149:0/2387823066 shutdown_connections 2024-08-17T02:47:43.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.261+0000 7fd8f3200640 1 -- 172.21.15.149:0/2387823066 wait complete. 2024-08-17T02:47:43.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.262+0000 7fd8f3200640 1 Processor -- start 2024-08-17T02:47:43.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.262+0000 7fd8f3200640 1 -- start start 2024-08-17T02:47:43.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 0x7fd8f41405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f3200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f4153440 0x7fd8f4155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f4159140 0x7fd8f40ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41563e0 con 0x7fd8f4153070 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f3200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40aeb90 con 0x7fd8f4153440 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40aee70 con 0x7fd8f4159140 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 0x7fd8f41405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 0x7fd8f41405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56408/0 (socket says 172.21.15.149:56408) 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.263+0000 7fd8f1e00640 1 -- 172.21.15.149:0/2373554385 learned_addr learned my addr 172.21.15.149:0/2373554385 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1400640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f4153440 0x7fd8f4155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f2800640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f4159140 0x7fd8f40ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1e00640 1 -- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f4159140 msgr2=0x7fd8f40ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1e00640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f4159140 0x7fd8f40ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1e00640 1 -- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f4153440 msgr2=0x7fd8f4155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1e00640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f4153440 0x7fd8f4155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1e00640 1 -- 172.21.15.149:0/2373554385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009a20 con 0x7fd8f4153070 2024-08-17T02:47:43.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f1e00640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 0x7fd8f41405e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c5e0 tx=0x7fd8e4007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4005aa0 con 0x7fd8f4153070 2024-08-17T02:47:43.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4005c00 con 0x7fd8f4153070 2024-08-17T02:47:43.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40070f0 con 0x7fd8f4153070 2024-08-17T02:47:43.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.264+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40af150 con 0x7fd8f4153070 2024-08-17T02:47:43.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.265+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40af710 con 0x7fd8f4153070 2024-08-17T02:47:43.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.265+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4071050 con 0x7fd8f4153070 2024-08-17T02:47:43.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.266+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8e4007520 con 0x7fd8f4153070 2024-08-17T02:47:43.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.267+0000 7fd8e9600640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd8d4065150 0x7fd8d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.267+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8e4081fb0 con 0x7fd8f4153070 2024-08-17T02:47:43.269 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.267+0000 7fd8f1400640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd8d4065150 0x7fd8d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.270 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.268+0000 7fd8f1400640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd8d4065150 0x7fd8d4067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40b0350 tx=0x7fd8e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.272+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8e4050050 con 0x7fd8f4153070 2024-08-17T02:47:43.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.506+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd8f40cc7a0 con 0x7fd8f4153070 2024-08-17T02:47:43.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.511+0000 7fd8e9600640 1 -- 172.21.15.149:0/2373554385 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd8e4053670 con 0x7fd8f4153070 2024-08-17T02:47:43.512 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd8d4065150 msgr2=0x7fd8d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd8d4065150 0x7fd8d4067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40b0350 tx=0x7fd8e0008040 comp rx=0 tx=0).stop 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 msgr2=0x7fd8f41405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 0x7fd8f41405e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c5e0 tx=0x7fd8e4007d60 comp rx=0 tx=0).stop 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 shutdown_connections 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd8d4065150 0x7fd8d4067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f4159140 0x7fd8f40ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f4153440 0x7fd8f4155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 --2- 172.21.15.149:0/2373554385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8f4153070 0x7fd8f41405e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 >> 172.21.15.149:0/2373554385 conn(0x7fd8f40cbc00 msgr2=0x7fd8f4157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 shutdown_connections 2024-08-17T02:47:43.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.513+0000 7fd8f3200640 1 -- 172.21.15.149:0/2373554385 wait complete. 2024-08-17T02:47:43.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:43.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 Processor -- start 2024-08-17T02:47:43.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 -- start start 2024-08-17T02:47:43.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40aed50 0x7f9cb40ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 0x7f9cb40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb40cc890 con 0x7f9cb40ce6d0 2024-08-17T02:47:43.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40ceb20 con 0x7f9cb40c5c40 2024-08-17T02:47:43.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.681+0000 7f9cb8a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40cb4c0 con 0x7f9cb40aed50 2024-08-17T02:47:43.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 0x7f9cb40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40aed50 0x7f9cb40ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 0x7f9cb40caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:60082/0 (socket says 172.21.15.149:60082) 2024-08-17T02:47:43.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3e00640 1 -- 172.21.15.149:0/1327668612 learned_addr learned my addr 172.21.15.149:0/1327668612 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:43.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9caaa00640 1 --1- 172.21.15.149:0/1327668612 >> v1:172.21.15.161:6789/0 conn(0x7f9cb40ce6d0 0x7f9cb40ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.149:41080/0 (socket says 172.21.15.149:41080) 2024-08-17T02:47:43.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3400640 1 -- 172.21.15.149:0/1327668612 >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 msgr2=0x7f9cb40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:43.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3400640 1 --2- 172.21.15.149:0/1327668612 >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 0x7f9cb40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3400640 1 -- 172.21.15.149:0/1327668612 >> v1:172.21.15.161:6789/0 conn(0x7f9cb40ce6d0 legacy=0x7f9cb40ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb2a00640 1 -- 172.21.15.149:0/1327668612 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661865754 0 0) 0x7f9cb40cc890 con 0x7f9cb40ce6d0 2024-08-17T02:47:43.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3400640 1 -- 172.21.15.149:0/1327668612 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40cb7a0 con 0x7f9cb40aed50 2024-08-17T02:47:43.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.682+0000 7f9cb3e00640 1 --2- 172.21.15.149:0/1327668612 >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 0x7f9cb40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:43.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.683+0000 7f9cb3400640 1 --2- 172.21.15.149:0/1327668612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40aed50 0x7f9cb40ce190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009850 tx=0x7f9ca40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb4143a68698f8b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb2a00640 1 -- 172.21.15.149:0/1327668612 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca402ad90 con 0x7f9cb40aed50 2024-08-17T02:47:43.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb2a00640 1 -- 172.21.15.149:0/1327668612 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4032440 con 0x7f9cb40aed50 2024-08-17T02:47:43.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb2a00640 1 -- 172.21.15.149:0/1327668612 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40327e0 con 0x7f9cb40aed50 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 -- 172.21.15.149:0/1327668612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40aed50 msgr2=0x7f9cb40ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/1327668612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40aed50 0x7f9cb40ce190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009850 tx=0x7f9ca40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 -- 172.21.15.149:0/1327668612 shutdown_connections 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/1327668612 >> v2:172.21.15.161:3300/0 conn(0x7f9cb40c5c40 0x7f9cb40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/1327668612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40aed50 0x7f9cb40ce190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 -- 172.21.15.149:0/1327668612 >> 172.21.15.149:0/1327668612 conn(0x7f9cb4098e30 msgr2=0x7f9cb406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 -- 172.21.15.149:0/1327668612 shutdown_connections 2024-08-17T02:47:43.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.684+0000 7f9cb8a00640 1 -- 172.21.15.149:0/1327668612 wait complete. 2024-08-17T02:47:43.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.686+0000 7f9cb8a00640 1 Processor -- start 2024-08-17T02:47:43.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.686+0000 7f9cb8a00640 1 -- start start 2024-08-17T02:47:43.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 0x7f9cb40c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb8a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40c5c40 0x7f9cb41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb8a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40ce6d0 0x7f9cb40b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb409d5a0 con 0x7f9cb40aed50 2024-08-17T02:47:43.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb8a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c7e80 con 0x7f9cb40ce6d0 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb8a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c8120 con 0x7f9cb40c5c40 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 0x7f9cb40c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 0x7f9cb40c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56412/0 (socket says 172.21.15.149:56412) 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb3400640 1 -- 172.21.15.149:0/153924309 learned_addr learned my addr 172.21.15.149:0/153924309 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9cb3e00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40ce6d0 0x7f9cb40b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.687+0000 7f9caaa00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40c5c40 0x7f9cb41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb3400640 1 -- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40c5c40 msgr2=0x7f9cb41562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb3400640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40c5c40 0x7f9cb41562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb3400640 1 -- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40ce6d0 msgr2=0x7f9cb40b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb3400640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40ce6d0 0x7f9cb40b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb3400640 1 -- 172.21.15.149:0/153924309 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009ae0 con 0x7f9cb40aed50 2024-08-17T02:47:43.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb3400640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 0x7f9cb40c7940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009850 tx=0x7f9ca4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4000d10 con 0x7f9cb40aed50 2024-08-17T02:47:43.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4031a60 con 0x7f9cb40aed50 2024-08-17T02:47:43.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca4009390 con 0x7f9cb40aed50 2024-08-17T02:47:43.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4031e60 con 0x7f9cb40aed50 2024-08-17T02:47:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.688+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb40c84b0 con 0x7f9cb40aed50 2024-08-17T02:47:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.689+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb4071050 con 0x7f9cb40aed50 2024-08-17T02:47:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.690+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ca403c400 con 0x7f9cb40aed50 2024-08-17T02:47:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.691+0000 7f9cab400640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9c90065150 0x7f9c90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.691+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ca40a2620 con 0x7f9cb40aed50 2024-08-17T02:47:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.691+0000 7f9caaa00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9c90065150 0x7f9c90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.692+0000 7f9caaa00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9c90065150 0x7f9c90067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40c9e00 tx=0x7f9c9c007e60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.695+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ca40706f0 con 0x7f9cb40aed50 2024-08-17T02:47:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.901+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cb406ede0 con 0x7f9cb40aed50 2024-08-17T02:47:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.901+0000 7f9cab400640 1 -- 172.21.15.149:0/153924309 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f9ca4073d10 con 0x7f9cb40aed50 2024-08-17T02:47:43.903 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:43.903 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:37.896789+0000","modified":"2024-08-17T02:47:41.522751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4870":{"gid":4870,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/807513628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":807513628},{"type":"v1","addr":"172.21.15.161:6835","nonce":807513628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:47:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2024-08-17T02:47:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.903+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9c90065150 msgr2=0x7f9c90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9c90065150 0x7f9c90067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40c9e00 tx=0x7f9c9c007e60 comp rx=0 tx=0).stop 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 msgr2=0x7f9cb40c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 0x7f9cb40c7940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009850 tx=0x7f9ca4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 shutdown_connections 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9c90065150 0x7f9c90067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40ce6d0 0x7f9cb40b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb40c5c40 0x7f9cb41562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 --2- 172.21.15.149:0/153924309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb40aed50 0x7f9cb40c7940 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 >> 172.21.15.149:0/153924309 conn(0x7f9cb4098e30 msgr2=0x7f9cb4158120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 shutdown_connections 2024-08-17T02:47:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:43.904+0000 7f9cb8a00640 1 -- 172.21.15.149:0/153924309 wait complete. 2024-08-17T02:47:44.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:47:37.896789+0000', 'modified': '2024-08-17T02:47:41.522751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4870': {'gid': 4870, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6835/807513628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6833', 'nonce': 807513628}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 807513628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:47:44.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:47:44.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:47:44.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.473+0000 7f962b800640 1 Processor -- start 2024-08-17T02:47:44.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.473+0000 7f962b800640 1 -- start start 2024-08-17T02:47:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.474+0000 7f962b800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155180 0x7f96240aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.474+0000 7f962b800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9624155550 0x7f96240ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.474+0000 7f962b800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f962406e080 0x7f962406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.474+0000 7f962b800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96240afc10 con 0x7f9624155550 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.474+0000 7f962b800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96240ae5b0 con 0x7f962406e080 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.474+0000 7f962b800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962406e9d0 con 0x7f9624155180 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9624155550 0x7f96240ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9624155550 0x7f96240ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56414/0 (socket says 172.21.15.149:56414) 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 -- 172.21.15.149:0/624122433 learned_addr learned my addr 172.21.15.149:0/624122433 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9628e00640 1 --2- 172.21.15.149:0/624122433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155180 0x7f96240aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9629800640 1 --2- 172.21.15.149:0/624122433 >> v2:172.21.15.161:3300/0 conn(0x7f962406e080 0x7f962406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 -- 172.21.15.149:0/624122433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155180 msgr2=0x7f96240aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 --2- 172.21.15.149:0/624122433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155180 0x7f96240aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 -- 172.21.15.149:0/624122433 >> v2:172.21.15.161:3300/0 conn(0x7f962406e080 msgr2=0x7f962406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 --2- 172.21.15.149:0/624122433 >> v2:172.21.15.161:3300/0 conn(0x7f962406e080 0x7f962406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.475+0000 7f9623e00640 1 -- 172.21.15.149:0/624122433 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240af000 con 0x7f9624155550 2024-08-17T02:47:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.476+0000 7f9623e00640 1 --2- 172.21.15.149:0/624122433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155550 0x7f96240ae070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9624064290 tx=0x7f961000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41e39afc84526f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.476+0000 7f9623400640 1 -- 172.21.15.149:0/624122433 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610032480 con 0x7f9624155550 2024-08-17T02:47:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.476+0000 7f9623400640 1 -- 172.21.15.149:0/624122433 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961002f030 con 0x7f9624155550 2024-08-17T02:47:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.476+0000 7f9623400640 1 -- 172.21.15.149:0/624122433 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610032850 con 0x7f9624155550 2024-08-17T02:47:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 -- 172.21.15.149:0/624122433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155550 msgr2=0x7f96240ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 --2- 172.21.15.149:0/624122433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155550 0x7f96240ae070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9624064290 tx=0x7f961000b4b0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 -- 172.21.15.149:0/624122433 shutdown_connections 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 --2- 172.21.15.149:0/624122433 >> v2:172.21.15.161:3300/0 conn(0x7f962406e080 0x7f962406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 --2- 172.21.15.149:0/624122433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155550 0x7f96240ae070 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 --2- 172.21.15.149:0/624122433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155180 0x7f96240aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 -- 172.21.15.149:0/624122433 >> 172.21.15.149:0/624122433 conn(0x7f96240cb9b0 msgr2=0x7f96240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 -- 172.21.15.149:0/624122433 shutdown_connections 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.477+0000 7f962b800640 1 -- 172.21.15.149:0/624122433 wait complete. 2024-08-17T02:47:44.482 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.478+0000 7f962b800640 1 Processor -- start 2024-08-17T02:47:44.482 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 -- start start 2024-08-17T02:47:44.482 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f962406e080 0x7f9624169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 0x7f96240abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155550 0x7f96240c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240ca6e0 con 0x7f9624155180 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240aae60 con 0x7f962406e080 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.479+0000 7f962b800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240a9dc0 con 0x7f9624155550 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 0x7f96240abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 0x7f96240abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56424/0 (socket says 172.21.15.149:56424) 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 -- 172.21.15.149:0/3312452963 learned_addr learned my addr 172.21.15.149:0/3312452963 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9629800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155550 0x7f96240c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9628e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f962406e080 0x7f9624169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 -- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155550 msgr2=0x7f96240c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155550 0x7f96240c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 -- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f962406e080 msgr2=0x7f9624169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f962406e080 0x7f9624169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 -- 172.21.15.149:0/3312452963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961000b6f0 con 0x7f9624155180 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9628e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f962406e080 0x7f9624169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9629800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155550 0x7f96240c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.480+0000 7f9623e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 0x7f96240abc00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f961000bbb0 tx=0x7f961003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.481+0000 7f9617e00640 1 -- 172.21.15.149:0/3312452963 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100356f0 con 0x7f9624155180 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.481+0000 7f9617e00640 1 -- 172.21.15.149:0/3312452963 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610035870 con 0x7f9624155180 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.481+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96240aa0a0 con 0x7f9624155180 2024-08-17T02:47:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.481+0000 7f9617e00640 1 -- 172.21.15.149:0/3312452963 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610035c30 con 0x7f9624155180 2024-08-17T02:47:44.485 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.481+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240aa940 con 0x7f9624155180 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.482+0000 7f9617e00640 1 -- 172.21.15.149:0/3312452963 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f961003c070 con 0x7f9624155180 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.483+0000 7f9617e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9604065150 0x7f9604067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.483+0000 7f9617e00640 1 -- 172.21.15.149:0/3312452963 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96100a3050 con 0x7f9624155180 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.484+0000 7f9628e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9604065150 0x7f9604067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.484+0000 7f962de01740 1 Processor -- start 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.484+0000 7f9628e00640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9604065150 0x7f9604067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9618006e70 tx=0x7f9618008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.484+0000 7f962de01740 1 -- start start 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f52040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f962de01740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f6f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f26b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f962de01740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79ee7240 con 0x55be79f2d2e0 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79e909e0 con 0x55be79f6fd50 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be79e8e170 con 0x55be79f51c70 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f9623e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f6f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f9623e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f6f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56430/0 (socket says 172.21.15.149:56430) 2024-08-17T02:47:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f9623e00640 1 -- 172.21.15.149:0/388118366 learned_addr learned my addr 172.21.15.149:0/388118366 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f9628e00640 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f52040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.485+0000 7f9629800640 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f26b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9623e00640 1 -- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 msgr2=0x55be79f52040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9623e00640 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f52040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9623e00640 1 -- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 msgr2=0x55be79f26b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9623e00640 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f26b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9623e00640 1 -- 172.21.15.149:0/388118366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be79e3d820 con 0x55be79f2d2e0 2024-08-17T02:47:44.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9629800640 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f26b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9623e00640 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f6f810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96100a1620 tx=0x7f96100a14d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3567a3d7f8cd9e84 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9614c00640 1 -- 172.21.15.149:0/388118366 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100754d0 con 0x55be79f2d2e0 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9614c00640 1 -- 172.21.15.149:0/388118366 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961007a0f0 con 0x55be79f2d2e0 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.486+0000 7f9614c00640 1 -- 172.21.15.149:0/388118366 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610074dd0 con 0x55be79f2d2e0 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 -- 172.21.15.149:0/388118366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 msgr2=0x55be79f6f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f6f810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96100a1620 tx=0x7f96100a14d0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 -- 172.21.15.149:0/388118366 shutdown_connections 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f26b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f6f810 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 --2- 172.21.15.149:0/388118366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f52040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 -- 172.21.15.149:0/388118366 >> 172.21.15.149:0/388118366 conn(0x55be79ec4a80 msgr2=0x55be79f73eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 -- 172.21.15.149:0/388118366 shutdown_connections 2024-08-17T02:47:44.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 -- 172.21.15.149:0/388118366 wait complete. 2024-08-17T02:47:44.492 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.487+0000 7f962de01740 1 -- start start 2024-08-17T02:47:44.492 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.488+0000 7f962de01740 1 Processor -- start 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f4e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f51c70 0x55be79f58cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f6fd50 0x55be79f53e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79e89f60 con 0x55be79f2d2e0 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79e32690 con 0x55be79f51c70 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be79e32330 con 0x55be79f6fd50 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f962de01740 10 client.0 _ll_register_callbacks cb 0x55be79e3bcc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f4e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.496 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f4e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56446/0 (socket says 172.21.15.149:56446) 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 -- 172.21.15.149:0/361573199 learned_addr learned my addr 172.21.15.149:0/361573199 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9629800640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f6fd50 0x55be79f53e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9623e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f51c70 0x55be79f58cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 -- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f6fd50 msgr2=0x55be79f53e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f6fd50 0x55be79f53e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 -- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f51c70 msgr2=0x55be79f58cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f51c70 0x55be79f58cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9628e00640 1 -- 172.21.15.149:0/361573199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240aa940 con 0x55be79f2d2e0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.489+0000 7f9623e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f51c70 0x55be79f58cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9628e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f4e920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9618015ba0 tx=0x7f9618019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307b70222e1084db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9609600640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9609600640 1 -- 172.21.15.149:0/361573199 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618016bf0 con 0x55be79f2d2e0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9609600640 1 -- 172.21.15.149:0/361573199 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9618016d50 con 0x55be79f2d2e0 2024-08-17T02:47:44.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be79ebd770 con 0x55be79f2d2e0 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9609600640 1 -- 172.21.15.149:0/361573199 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9618022630 con 0x55be79f2d2e0 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 10 client.5136 fetch_fsmap learned FSMap version 17 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55be79e53ab0 con 0x55be79f2d2e0 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9609600640 1 -- 172.21.15.149:0/361573199 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be79ebd770 con 0x55be79f2d2e0 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f9609600640 1 -- 172.21.15.149:0/361573199 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9618022790 con 0x55be79f2d2e0 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 10 client.5136 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 10 client.5136 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 20 client.5136 populate_metadata read hostname 'smithi149' 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f27350 0x55be79f27720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.490+0000 7f962de01740 4 client.5136 mds_command: new command op to 4870 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.491+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 --> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be79b913c0 con 0x55be79f27350 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.491+0000 7f9623e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f27350 0x55be79f27720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.491+0000 7f9609600640 10 client.5136 ms_handle_connect on v2:172.21.15.161:6833/807513628 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.491+0000 7f9623e00640 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f27350 0x55be79f27720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f690c1bb590ea80 server_cookie=1118ca07a08c8fdb in_seq=0 out_seq=0 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f9609600640 1 -- 172.21.15.149:0/361573199 <== mds.0 v2:172.21.15.161:6833/807513628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55be79b913c0 con 0x55be79f27350 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f9609600640 10 client.5136 handle_command_reply: tid=0 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 client.5136 shutdown 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 msgr2=0x55be79f4e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f4e920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9618015ba0 tx=0x7f9618019040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 shutdown_connections 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f27350 0x55be79f27720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f6fd50 0x55be79f53e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f51c70 0x55be79f58cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f9609600640 0 client.5136 ms_handle_reset on v2:172.21.15.161:6833/807513628 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 --2- 172.21.15.149:0/361573199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f4e920 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.499 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 >> 172.21.15.149:0/361573199 conn(0x55be79ec4a80 msgr2=0x55be79f25810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 shutdown_connections 2024-08-17T02:47:44.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 1 -- 172.21.15.149:0/361573199 wait complete. 2024-08-17T02:47:44.500 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.493+0000 7f962de01740 20 client.5136 trim_cache size 0 max 16384 2024-08-17T02:47:44.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.509+0000 7f962de01740 1 Processor -- start 2024-08-17T02:47:44.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.509+0000 7f962de01740 1 -- start start 2024-08-17T02:47:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f962de01740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f2c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f56130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f73b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f962de01740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79c04f20 con 0x55be79f2d2e0 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79f59540 con 0x55be79f6fd50 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be79f55c20 con 0x55be79f51c70 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f2c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f2c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56450/0 (socket says 172.21.15.149:56450) 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 -- 172.21.15.149:0/1657596551 learned_addr learned my addr 172.21.15.149:0/1657596551 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9629800640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f73b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9623e00640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 -- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 msgr2=0x55be79f56130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f56130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 -- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 msgr2=0x55be79f73b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.510+0000 7f9628e00640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f73b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9628e00640 1 -- 172.21.15.149:0/1657596551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be79ec61c0 con 0x55be79f2d2e0 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9629800640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f73b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9623e00640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9628e00640 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f2c060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9618010b20 tx=0x7f961801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a32dac4d8cecc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9615600640 1 -- 172.21.15.149:0/1657596551 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618022cf0 con 0x55be79f2d2e0 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9615600640 1 -- 172.21.15.149:0/1657596551 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618009e40 con 0x55be79f2d2e0 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.511+0000 7f9615600640 1 -- 172.21.15.149:0/1657596551 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618016bf0 con 0x55be79f2d2e0 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 -- 172.21.15.149:0/1657596551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 msgr2=0x55be79f2c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f2c060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9618010b20 tx=0x7f961801c000 comp rx=0 tx=0).stop 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 -- 172.21.15.149:0/1657596551 shutdown_connections 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f6fd50 0x55be79f73b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79f56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 --2- 172.21.15.149:0/1657596551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f2d2e0 0x55be79f2c060 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 -- 172.21.15.149:0/1657596551 >> 172.21.15.149:0/1657596551 conn(0x55be79ec4a80 msgr2=0x55be79f27720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 -- 172.21.15.149:0/1657596551 shutdown_connections 2024-08-17T02:47:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 -- 172.21.15.149:0/1657596551 wait complete. 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.512+0000 7f962de01740 1 -- start start 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.513+0000 7f962de01740 1 Processor -- start 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.513+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f2d2e0 0x55be79f73f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f962de01740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79fd75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f962de01740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 0x55be79fd7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f962de01740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79fd8040 con 0x55be79f6fd50 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be79f8f5c0 con 0x55be79f2d2e0 2024-08-17T02:47:44.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f962de01740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be79f555e0 con 0x55be79f51c70 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f962de01740 10 client.0 _ll_register_callbacks cb 0x7f961002cb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 0x55be79fd7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 0x55be79fd7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56456/0 (socket says 172.21.15.149:56456) 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 -- 172.21.15.149:0/3623755460 learned_addr learned my addr 172.21.15.149:0/3623755460 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9628e00640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f2d2e0 0x55be79f73f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9623e00640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79fd75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 -- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 msgr2=0x55be79fd75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79fd75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 -- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f2d2e0 msgr2=0x55be79f73f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f2d2e0 0x55be79f73f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.514+0000 7f9629800640 1 -- 172.21.15.149:0/3623755460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be79e53ab0 con 0x55be79f6fd50 2024-08-17T02:47:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9629800640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 0x55be79fd7b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f961c0094d0 tx=0x7f961c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1b27060ed77e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9609600640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9609600640 1 -- 172.21.15.149:0/3623755460 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00e040 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9609600640 1 -- 172.21.15.149:0/3623755460 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f961c017440 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f961007a0f0 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9609600640 1 -- 172.21.15.149:0/3623755460 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f961c014ea0 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 10 client.5142 fetch_fsmap learned FSMap version 17 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55be79e57490 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9609600640 1 -- 172.21.15.149:0/3623755460 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961007a0f0 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f9609600640 1 -- 172.21.15.149:0/3623755460 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f961c017810 con 0x55be79f6fd50 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 10 client.5142 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 10 client.5142 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 20 client.5142 populate_metadata read hostname 'smithi149' 2024-08-17T02:47:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f81f70 0x55be79f82340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 4 client.5142 mds_command: new command op to 4870 tid=0[{"prefix": "status"}] 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.515+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 --> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be79ba26c0 con 0x55be79f81f70 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.516+0000 7f9628e00640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f81f70 0x55be79f82340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.516+0000 7f9628e00640 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f81f70 0x55be79f82340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425806d438f1bfee server_cookie=9e63c0d05482dbc8 in_seq=0 out_seq=0 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.516+0000 7f9609600640 10 client.5142 ms_handle_connect on v2:172.21.15.161:6833/807513628 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f9609600640 1 -- 172.21.15.149:0/3623755460 <== mds.0 v2:172.21.15.161:6833/807513628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55be79ba26c0 con 0x55be79f81f70 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f9609600640 10 client.5142 handle_command_reply: tid=0 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 client.5142 shutdown 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 msgr2=0x55be79fd7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 0x55be79fd7b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f961c0094d0 tx=0x7f961c00b040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 shutdown_connections 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be79f6fd50 0x55be79fd7b00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:6833/807513628,v1:172.21.15.161:6835/807513628] conn(0x55be79f81f70 0x55be79f82340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55be79f51c70 0x55be79fd75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 --2- 172.21.15.149:0/3623755460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be79f2d2e0 0x55be79f73f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f9609600640 0 client.5142 ms_handle_reset on v2:172.21.15.161:6833/807513628 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 >> 172.21.15.149:0/3623755460 conn(0x55be79ec4a80 msgr2=0x55be79f2c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 shutdown_connections 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 1 -- 172.21.15.149:0/3623755460 wait complete. 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.517+0000 7f962de01740 20 client.5142 trim_cache size 0 max 16384 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "b8d2e793-20e6-428a-8b1c-2d641058b12a", 2024-08-17T02:47:44.524 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4870, 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 6.018755166, 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 17, 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 34, 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 34, 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 13.963548099 2024-08-17T02:47:44.525 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9604065150 msgr2=0x7f9604067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9604065150 0x7f9604067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9618006e70 tx=0x7f9618008040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 msgr2=0x7f96240abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 0x7f96240abc00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f961000bbb0 tx=0x7f961003a000 comp rx=0 tx=0).stop 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 shutdown_connections 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9604065150 0x7f9604067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9624155550 0x7f96240c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9624155180 0x7f96240abc00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 --2- 172.21.15.149:0/3312452963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f962406e080 0x7f9624169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 >> 172.21.15.149:0/3312452963 conn(0x7f96240cb9b0 msgr2=0x7f9624069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 shutdown_connections 2024-08-17T02:47:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.518+0000 7f962b800640 1 -- 172.21.15.149:0/3312452963 wait complete. 2024-08-17T02:47:44.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:44.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.681+0000 7f8e39400640 1 Processor -- start 2024-08-17T02:47:44.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.681+0000 7f8e39400640 1 -- start start 2024-08-17T02:47:44.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.682+0000 7f8e39400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8e34155df0 0x7f8e340adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.682+0000 7f8e39400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e34156670 con 0x7f8e34155a20 2024-08-17T02:47:44.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.682+0000 7f8e39400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3406e5e0 con 0x7f8e3406df00 2024-08-17T02:47:44.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.682+0000 7f8e39400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e340b0350 con 0x7f8e34155df0 2024-08-17T02:47:44.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e32800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8e34155a20 0x7f8e3406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57530/0 (socket says 172.21.15.149:57530) 2024-08-17T02:47:44.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e32800640 1 -- 172.21.15.149:0/1146094487 learned_addr learned my addr 172.21.15.149:0/1146094487 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:44.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e33200640 1 --2- 172.21.15.149:0/1146094487 >> v2:172.21.15.149:3300/0 conn(0x7f8e34155df0 0x7f8e340adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e31400640 1 -- 172.21.15.149:0/1146094487 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173937917 0 0) 0x7f8e34156670 con 0x7f8e34155a20 2024-08-17T02:47:44.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e31400640 1 -- 172.21.15.149:0/1146094487 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e180034e0 con 0x7f8e34155a20 2024-08-17T02:47:44.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e33200640 1 -- 172.21.15.149:0/1146094487 >> v1:172.21.15.161:6789/0 conn(0x7f8e3406df00 legacy=0x7f8e34156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e33200640 1 -- 172.21.15.149:0/1146094487 >> v1:172.21.15.149:6789/0 conn(0x7f8e34155a20 legacy=0x7f8e3406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.683+0000 7f8e33200640 1 -- 172.21.15.149:0/1146094487 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3406e8c0 con 0x7f8e34155df0 2024-08-17T02:47:44.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.684+0000 7f8e33200640 1 --2- 172.21.15.149:0/1146094487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e340adf10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a542fcb10cafded server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e31400640 1 -- 172.21.15.149:0/1146094487 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c032640 con 0x7f8e34155df0 2024-08-17T02:47:44.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e31400640 1 -- 172.21.15.149:0/1146094487 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0327a0 con 0x7f8e34155df0 2024-08-17T02:47:44.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e31400640 1 -- 172.21.15.149:0/1146094487 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c032b40 con 0x7f8e34155df0 2024-08-17T02:47:44.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 -- 172.21.15.149:0/1146094487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 msgr2=0x7f8e340adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 --2- 172.21.15.149:0/1146094487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e340adf10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:44.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 -- 172.21.15.149:0/1146094487 shutdown_connections 2024-08-17T02:47:44.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 --2- 172.21.15.149:0/1146094487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e340adf10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 -- 172.21.15.149:0/1146094487 >> 172.21.15.149:0/1146094487 conn(0x7f8e340cb9b0 msgr2=0x7f8e340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 -- 172.21.15.149:0/1146094487 shutdown_connections 2024-08-17T02:47:44.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.685+0000 7f8e39400640 1 -- 172.21.15.149:0/1146094487 wait complete. 2024-08-17T02:47:44.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.687+0000 7f8e39400640 1 Processor -- start 2024-08-17T02:47:44.688 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.687+0000 7f8e39400640 1 -- start start 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e39400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3406df00 0x7f8e340c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e39400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e34155a20 0x7f8e34147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e39400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e341475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e39400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e340ad560 con 0x7f8e34155df0 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e39400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e340ac9e0 con 0x7f8e34155a20 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e39400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e340accc0 con 0x7f8e3406df00 2024-08-17T02:47:44.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e341475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e341475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56476/0 (socket says 172.21.15.149:56476) 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 -- 172.21.15.149:0/2776088913 learned_addr learned my addr 172.21.15.149:0/2776088913 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e32800640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3406df00 0x7f8e340c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e31e00640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e34155a20 0x7f8e34147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 -- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3406df00 msgr2=0x7f8e340c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3406df00 0x7f8e340c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 -- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e34155a20 msgr2=0x7f8e34147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e34155a20 0x7f8e34147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e33200640 1 -- 172.21.15.149:0/2776088913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c009a20 con 0x7f8e34155df0 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.688+0000 7f8e31e00640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e34155a20 0x7f8e34147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:44.691 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.689+0000 7f8e33200640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e341475a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0099f0 tx=0x7f8e2c03a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.689+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00e050 con 0x7f8e34155df0 2024-08-17T02:47:44.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.689+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c03caf0 con 0x7f8e34155df0 2024-08-17T02:47:44.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.689+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0463f0 con 0x7f8e34155df0 2024-08-17T02:47:44.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.689+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e340acfa0 con 0x7f8e34155df0 2024-08-17T02:47:44.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.689+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e340c3fd0 con 0x7f8e34155df0 2024-08-17T02:47:44.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.690+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e34064db0 con 0x7f8e34155df0 2024-08-17T02:47:44.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.691+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e2c04f450 con 0x7f8e34155df0 2024-08-17T02:47:44.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.692+0000 7f8e2a000640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8e14065150 0x7f8e14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.692+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e2c0a38d0 con 0x7f8e34155df0 2024-08-17T02:47:44.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.692+0000 7f8e32800640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8e14065150 0x7f8e14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.693+0000 7f8e32800640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8e14065150 0x7f8e14067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005840 tx=0x7f8e24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.697+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e2c0718f0 con 0x7f8e34155df0 2024-08-17T02:47:44.903 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.903+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8e34156b90 con 0x7f8e34155df0 2024-08-17T02:47:44.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.904+0000 7f8e2a000640 1 -- 172.21.15.149:0/2776088913 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8e2c036060 con 0x7f8e34155df0 2024-08-17T02:47:44.904 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:44.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8e14065150 msgr2=0x7f8e14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8e14065150 0x7f8e14067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005840 tx=0x7f8e24009040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 msgr2=0x7f8e341475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e341475a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0099f0 tx=0x7f8e2c03a000 comp rx=0 tx=0).stop 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 shutdown_connections 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8e14065150 0x7f8e14067600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e34155df0 0x7f8e341475a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e34155a20 0x7f8e34147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 --2- 172.21.15.149:0/2776088913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3406df00 0x7f8e340c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 >> 172.21.15.149:0/2776088913 conn(0x7f8e340cb9b0 msgr2=0x7f8e34152580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 shutdown_connections 2024-08-17T02:47:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:44.906+0000 7f8e39400640 1 -- 172.21.15.149:0/2776088913 wait complete. 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:47:44.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:44.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:44.923 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-08-17T02:47:44.959 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:44.959 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:44.960 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42613sec preferred_lft 42613sec 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 7e:63:94:ef:0b:68 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::2c58:f4ff:fe1a:1834/64 scope link 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 7e:63:94:ef:0b:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::7c63:94ff:feef:b68/64 scope link 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:92:6a:26:c2:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c492:6aff:fe26:c20e/64 scope link 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:44.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:44.962 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:45.053 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-08-17T02:47:45.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:45.059 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:45.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:45.096 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-08-17T02:47:45.096 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-08-17T02:47:45.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:45.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:45.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:45.096 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-08-17T02:47:45.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:45.241 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:47:45.276 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:47:45.276 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:47:45.277 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:45.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:45.277 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-08-17T02:47:45.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:45.373 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:45.408 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:45.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:45.409 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:45.484 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:47:45.484 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:45.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:45.607 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:45.607 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:45.634 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:45.635 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:45.635 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-08-17T02:47:45.635 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 0@b8d2e793-20e6-428a-8b1c-2d641058b12a.cephfs=/ 2024-08-17T02:47:45.635 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.149:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-08-17T02:47:45.636 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:47:45.636 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:45.636 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:45.636 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:45.636 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:45.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:45.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:45.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:45.696 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:45.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.844+0000 7fb1b2e00640 1 Processor -- start 2024-08-17T02:47:45.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.844+0000 7fb1b2e00640 1 -- start start 2024-08-17T02:47:45.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.845+0000 7fb1b2e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.845+0000 7fb1b2e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1ac06df00 0x7fb1ac0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.845+0000 7fb1b2e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac156670 con 0x7fb1ac155df0 2024-08-17T02:47:45.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.845+0000 7fb1b2e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0b0350 con 0x7fb1ac06df00 2024-08-17T02:47:45.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.845+0000 7fb1b2e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac06e5e0 con 0x7fb1ac155a20 2024-08-17T02:47:45.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1a3e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb1ac155df0 0x7fb1ac06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57546/0 (socket says 172.21.15.149:57546) 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1a3e00640 1 -- 172.21.15.149:0/1370481706 learned_addr learned my addr 172.21.15.149:0/1370481706 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1b0e00640 1 --2- 172.21.15.149:0/1370481706 >> v2:172.21.15.149:3300/0 conn(0x7fb1ac06df00 0x7fb1ac0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1abe00640 1 --2- 172.21.15.149:0/1370481706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1ab400640 1 -- 172.21.15.149:0/1370481706 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181038480 0 0) 0x7fb1ac156670 con 0x7fb1ac155df0 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1b0e00640 1 -- 172.21.15.149:0/1370481706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 msgr2=0x7fb1ac0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1b0e00640 1 --2- 172.21.15.149:0/1370481706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1b0e00640 1 -- 172.21.15.149:0/1370481706 >> v1:172.21.15.149:6789/0 conn(0x7fb1ac155df0 legacy=0x7fb1ac06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.846+0000 7fb1b0e00640 1 -- 172.21.15.149:0/1370481706 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac06e8c0 con 0x7fb1ac06df00 2024-08-17T02:47:45.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.847+0000 7fb1b0e00640 1 --2- 172.21.15.149:0/1370481706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac06df00 0x7fb1ac0ad9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009e60 tx=0x7fb1a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f5bde0613372bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.847+0000 7fb1ab400640 1 -- 172.21.15.149:0/1370481706 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4007550 con 0x7fb1ac06df00 2024-08-17T02:47:45.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.847+0000 7fb1ab400640 1 -- 172.21.15.149:0/1370481706 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a402d050 con 0x7fb1ac06df00 2024-08-17T02:47:45.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.847+0000 7fb1ab400640 1 -- 172.21.15.149:0/1370481706 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40078e0 con 0x7fb1ac06df00 2024-08-17T02:47:45.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 -- 172.21.15.149:0/1370481706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac06df00 msgr2=0x7fb1ac0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/1370481706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac06df00 0x7fb1ac0ad9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009e60 tx=0x7fb1a4009780 comp rx=0 tx=0).stop 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 -- 172.21.15.149:0/1370481706 shutdown_connections 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/1370481706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac06df00 0x7fb1ac0ad9b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/1370481706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 -- 172.21.15.149:0/1370481706 >> 172.21.15.149:0/1370481706 conn(0x7fb1ac0cb9b0 msgr2=0x7fb1ac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 -- 172.21.15.149:0/1370481706 shutdown_connections 2024-08-17T02:47:45.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.848+0000 7fb1b2e00640 1 -- 172.21.15.149:0/1370481706 wait complete. 2024-08-17T02:47:45.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.849+0000 7fb1b2e00640 1 Processor -- start 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 -- start start 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1ac06df00 0x7fb1ac151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 0x7fb1ac0c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0a9470 con 0x7fb1ac155df0 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac151670 con 0x7fb1ac06df00 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.850+0000 7fb1b2e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0ad180 con 0x7fb1ac155a20 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 0x7fb1ac0c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 0x7fb1ac0c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56488/0 (socket says 172.21.15.149:56488) 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 -- 172.21.15.149:0/957894298 learned_addr learned my addr 172.21.15.149:0/957894298 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1a3e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1abe00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1ac06df00 0x7fb1ac151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 -- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 msgr2=0x7fb1ac0c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 -- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1ac06df00 msgr2=0x7fb1ac151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1ac06df00 0x7fb1ac151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.851+0000 7fb1b0e00640 1 -- 172.21.15.149:0/957894298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4009a20 con 0x7fb1ac155df0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.852+0000 7fb1b0e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 0x7fb1ac0c1d00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40099f0 tx=0x7fb1a4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.852+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4031960 con 0x7fb1ac155df0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.852+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4040070 con 0x7fb1ac155df0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.852+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac0ad460 con 0x7fb1ac155df0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.852+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4031cf0 con 0x7fb1ac155df0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.852+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac0a9100 con 0x7fb1ac155df0 2024-08-17T02:47:45.854 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.853+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac0a9620 con 0x7fb1ac155df0 2024-08-17T02:47:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.854+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb1a4042030 con 0x7fb1ac155df0 2024-08-17T02:47:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.855+0000 7fb1a3400640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb188065150 0x7fb188067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.855+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1a40a3ce0 con 0x7fb1ac155df0 2024-08-17T02:47:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.855+0000 7fb1abe00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb188065150 0x7fb188067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.855+0000 7fb1abe00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb188065150 0x7fb188067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb19c007ba0 tx=0x7fb19c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:45.859+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb1ac0a9620 con 0x7fb1ac155df0 2024-08-17T02:47:46.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.069+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1ac064db0 con 0x7fb1ac155df0 2024-08-17T02:47:46.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.069+0000 7fb1a3400640 1 -- 172.21.15.149:0/957894298 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb1a4071db0 con 0x7fb1ac155df0 2024-08-17T02:47:46.070 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:46.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb188065150 msgr2=0x7fb188067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb188065150 0x7fb188067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb19c007ba0 tx=0x7fb19c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 msgr2=0x7fb1ac0c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 0x7fb1ac0c1d00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40099f0 tx=0x7fb1a4037000 comp rx=0 tx=0).stop 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 shutdown_connections 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb188065150 0x7fb188067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ac155df0 0x7fb1ac0c1d00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.071+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1ac155a20 0x7fb1ac0c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.072+0000 7fb1b2e00640 1 --2- 172.21.15.149:0/957894298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1ac06df00 0x7fb1ac151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.072+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 >> 172.21.15.149:0/957894298 conn(0x7fb1ac0cb9b0 msgr2=0x7fb1ac0ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.072+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 shutdown_connections 2024-08-17T02:47:46.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:46.072+0000 7fb1b2e00640 1 -- 172.21.15.149:0/957894298 wait complete. 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:46.088 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:46.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.089 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-08-17T02:47:46.130 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:46.130 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:46.130 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:46.131 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42597sec preferred_lft 42597sec 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 42:4a:7c:07:4a:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::106a:e1ff:fea6:bef0/64 scope link 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 42:4a:7c:07:4a:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::404a:7cff:fe07:4a03/64 scope link 2024-08-17T02:47:46.132 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.133 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:46.133 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether aa:7d:c8:32:3f:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:47:46.133 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::a87d:c8ff:fe32:3f79/64 scope link 2024-08-17T02:47:46.133 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:46.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.133 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:46.230 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-08-17T02:47:46.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.233 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-08-17T02:47:46.271 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-08-17T02:47:46.271 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:46.271 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:46.271 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:46.271 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:46.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.272 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-08-17T02:47:46.272 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-08-17T02:47:46.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:46.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:46.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:46.272 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-08-17T02:47:46.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.418 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:47:46.453 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:47:46.454 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:47:46.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:46.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.454 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-08-17T02:47:46.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:46.555 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:46.591 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:46.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:46.591 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:46.666 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:47:46.666 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:46.666 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:46.788 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:46.789 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:46.815 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:46.816 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:46.816 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-08-17T02:47:46.816 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 1@b8d2e793-20e6-428a-8b1c-2d641058b12a.cephfs=/ 2024-08-17T02:47:46.816 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.149:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-08-17T02:47:46.817 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:47:46.817 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:46.817 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:46.818 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:46.818 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:46.820 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:46.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:46.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:46.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:47:47.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.028+0000 7f2a38c00640 1 Processor -- start 2024-08-17T02:47:47.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.029+0000 7f2a38c00640 1 -- start start 2024-08-17T02:47:47.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a38c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a340af800 0x7f2a34160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a38c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a34157840 con 0x7f2a34155880 2024-08-17T02:47:47.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a38c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a340aed40 con 0x7f2a34155c50 2024-08-17T02:47:47.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a38c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a34156c30 con 0x7f2a340af800 2024-08-17T02:47:47.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a33400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2a34155880 0x7f2a340ae630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37566/0 (socket says 172.21.15.149:37566) 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a33400640 1 -- 172.21.15.149:0/3445928622 learned_addr learned my addr 172.21.15.149:0/3445928622 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.030+0000 7f2a33e00640 1 --2- 172.21.15.149:0/3445928622 >> v2:172.21.15.161:3300/0 conn(0x7f2a340af800 0x7f2a34160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.031+0000 7f2a32000640 1 -- 172.21.15.149:0/3445928622 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849034664 0 0) 0x7f2a34157840 con 0x7f2a34155880 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.031+0000 7f2a32000640 1 -- 172.21.15.149:0/3445928622 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a180034e0 con 0x7f2a34155880 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.031+0000 7f2a33e00640 1 -- 172.21.15.149:0/3445928622 >> v1:172.21.15.161:6789/0 conn(0x7f2a34155c50 legacy=0x7f2a340af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.031+0000 7f2a32000640 1 -- 172.21.15.149:0/3445928622 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254942661 0 0) 0x7f2a340aed40 con 0x7f2a34155c50 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.031+0000 7f2a33e00640 1 -- 172.21.15.149:0/3445928622 >> v1:172.21.15.149:6789/0 conn(0x7f2a34155880 legacy=0x7f2a340ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.031+0000 7f2a33e00640 1 -- 172.21.15.149:0/3445928622 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34156f10 con 0x7f2a340af800 2024-08-17T02:47:47.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.032+0000 7f2a33e00640 1 --2- 172.21.15.149:0/3445928622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a340af800 0x7f2a34160a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009e60 tx=0x7f2a2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f76f27916764b480 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.032+0000 7f2a32000640 1 -- 172.21.15.149:0/3445928622 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c007550 con 0x7f2a340af800 2024-08-17T02:47:47.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.032+0000 7f2a32000640 1 -- 172.21.15.149:0/3445928622 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c02d050 con 0x7f2a340af800 2024-08-17T02:47:47.033 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.032+0000 7f2a32000640 1 -- 172.21.15.149:0/3445928622 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0078c0 con 0x7f2a340af800 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 -- 172.21.15.149:0/3445928622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a340af800 msgr2=0x7f2a34160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 --2- 172.21.15.149:0/3445928622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a340af800 0x7f2a34160a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009e60 tx=0x7f2a2c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 -- 172.21.15.149:0/3445928622 shutdown_connections 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 --2- 172.21.15.149:0/3445928622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a340af800 0x7f2a34160a50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 -- 172.21.15.149:0/3445928622 >> 172.21.15.149:0/3445928622 conn(0x7f2a34067750 msgr2=0x7f2a340cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 -- 172.21.15.149:0/3445928622 shutdown_connections 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.033+0000 7f2a38c00640 1 -- 172.21.15.149:0/3445928622 wait complete. 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.034+0000 7f2a38c00640 1 Processor -- start 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 -- start start 2024-08-17T02:47:47.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a340af800 0x7f2a341511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 0x7f2a340c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a34155c50 0x7f2a340c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3416a4e0 con 0x7f2a34155880 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3415c7a0 con 0x7f2a34155c50 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.035+0000 7f2a38c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340c1270 con 0x7f2a340af800 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 0x7f2a340c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 0x7f2a340c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42900/0 (socket says 172.21.15.149:42900) 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 -- 172.21.15.149:0/806891902 learned_addr learned my addr 172.21.15.149:0/806891902 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a33e00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a34155c50 0x7f2a340c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a33400640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a340af800 0x7f2a341511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 -- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a340af800 msgr2=0x7f2a341511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a340af800 0x7f2a341511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 -- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a34155c50 msgr2=0x7f2a340c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a34155c50 0x7f2a340c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 -- 172.21.15.149:0/806891902 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009a20 con 0x7f2a34155880 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a33e00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a34155c50 0x7f2a340c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.036+0000 7f2a32a00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 0x7f2a340c2410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c5b0 tx=0x7f2a20007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.037+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20012630 con 0x7f2a34155880 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.037+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a200127b0 con 0x7f2a34155880 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.037+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a340c1550 con 0x7f2a34155880 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.037+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20012b70 con 0x7f2a34155880 2024-08-17T02:47:47.039 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.037+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a340c1830 con 0x7f2a34155880 2024-08-17T02:47:47.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.038+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3415c930 con 0x7f2a34155880 2024-08-17T02:47:47.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.039+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2a2001b400 con 0x7f2a34155880 2024-08-17T02:47:47.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.040+0000 7f2a2aa00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2a140651d0 0x7f2a14067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.040+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a200820c0 con 0x7f2a34155880 2024-08-17T02:47:47.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.040+0000 7f2a33400640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2a140651d0 0x7f2a14067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.041+0000 7f2a33400640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2a140651d0 0x7f2a14067680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005840 tx=0x7f2a24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.044+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2a200500e0 con 0x7f2a34155880 2024-08-17T02:47:47.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.253+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a34071050 con 0x7f2a34155880 2024-08-17T02:47:47.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.552+0000 7f2a2aa00640 1 -- 172.21.15.149:0/806891902 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f2a20053700 con 0x7f2a34155880 2024-08-17T02:47:47.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.554+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2a140651d0 msgr2=0x7f2a14067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.554+0000 7f2a38c00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2a140651d0 0x7f2a14067680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005840 tx=0x7f2a24009040 comp rx=0 tx=0).stop 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.554+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 msgr2=0x7f2a340c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.554+0000 7f2a38c00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 0x7f2a340c2410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c5b0 tx=0x7f2a20007d60 comp rx=0 tx=0).stop 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 shutdown_connections 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2a140651d0 0x7f2a14067680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a34155c50 0x7f2a340c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a34155880 0x7f2a340c2410 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 --2- 172.21.15.149:0/806891902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a340af800 0x7f2a341511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 >> 172.21.15.149:0/806891902 conn(0x7f2a34067750 msgr2=0x7f2a34153180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 shutdown_connections 2024-08-17T02:47:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.555+0000 7f2a38c00640 1 -- 172.21.15.149:0/806891902 wait complete. 2024-08-17T02:47:47.571 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:47:47.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.721+0000 7f47c2200640 1 Processor -- start 2024-08-17T02:47:47.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.721+0000 7f47c2200640 1 -- start start 2024-08-17T02:47:47.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47c2200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47bc155550 0x7f47bc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47c2200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f47bc06e080 0x7f47bc06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47c2200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0afc10 con 0x7f47bc155180 2024-08-17T02:47:47.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47c2200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc06ea00 con 0x7f47bc155550 2024-08-17T02:47:47.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47c2200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc0af000 con 0x7f47bc06e080 2024-08-17T02:47:47.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47b2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47bc155550 0x7f47bc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47b2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47bc155550 0x7f47bc0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42906/0 (socket says 172.21.15.149:42906) 2024-08-17T02:47:47.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.722+0000 7f47b2a00640 1 -- 172.21.15.149:0/1708445896 learned_addr learned my addr 172.21.15.149:0/1708445896 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:47.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.723+0000 7f47bbe00640 1 --2- 172.21.15.149:0/1708445896 >> v2:172.21.15.161:3300/0 conn(0x7f47bc06e080 0x7f47bc06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.723+0000 7f47b2a00640 1 -- 172.21.15.149:0/1708445896 >> v2:172.21.15.161:3300/0 conn(0x7f47bc06e080 msgr2=0x7f47bc06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.723+0000 7f47b2a00640 1 --2- 172.21.15.149:0/1708445896 >> v2:172.21.15.161:3300/0 conn(0x7f47bc06e080 0x7f47bc06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.723+0000 7f47b2a00640 1 -- 172.21.15.149:0/1708445896 >> v1:172.21.15.161:6789/0 conn(0x7f47bc155180 legacy=0x7f47bc0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.723+0000 7f47b2a00640 1 -- 172.21.15.149:0/1708445896 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0af2e0 con 0x7f47bc155550 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.724+0000 7f47b2a00640 1 --2- 172.21.15.149:0/1708445896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0aea20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0642c0 tx=0x7f47a400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6512749328fe9b69 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.724+0000 7f47baa00640 1 -- 172.21.15.149:0/1708445896 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4032480 con 0x7f47bc155550 2024-08-17T02:47:47.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.724+0000 7f47baa00640 1 -- 172.21.15.149:0/1708445896 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a402f030 con 0x7f47bc155550 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.724+0000 7f47baa00640 1 -- 172.21.15.149:0/1708445896 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4032850 con 0x7f47bc155550 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 -- 172.21.15.149:0/1708445896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 msgr2=0x7f47bc0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 --2- 172.21.15.149:0/1708445896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0aea20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0642c0 tx=0x7f47a400b4b0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 -- 172.21.15.149:0/1708445896 shutdown_connections 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 --2- 172.21.15.149:0/1708445896 >> v2:172.21.15.161:3300/0 conn(0x7f47bc06e080 0x7f47bc06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 --2- 172.21.15.149:0/1708445896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0aea20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 -- 172.21.15.149:0/1708445896 >> 172.21.15.149:0/1708445896 conn(0x7f47bc0cb9b0 msgr2=0x7f47bc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 -- 172.21.15.149:0/1708445896 shutdown_connections 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.725+0000 7f47c2200640 1 -- 172.21.15.149:0/1708445896 wait complete. 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.726+0000 7f47c2200640 1 Processor -- start 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.726+0000 7f47c2200640 1 -- start start 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47c2200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc06e080 0x7f47bc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.730 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47c2200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc155180 0x7f47bc14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47c2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47c2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1571b0 con 0x7f47bc155550 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47c2200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc14a820 con 0x7f47bc155180 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47c2200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0c9210 con 0x7f47bc06e080 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47bbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47bbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42910/0 (socket says 172.21.15.149:42910) 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47bbe00640 1 -- 172.21.15.149:0/881810417 learned_addr learned my addr 172.21.15.149:0/881810417 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.727+0000 7f47b2a00640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc155180 0x7f47bc14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bb400640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc06e080 0x7f47bc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bbe00640 1 -- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc06e080 msgr2=0x7f47bc1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bbe00640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc06e080 0x7f47bc1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bbe00640 1 -- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc155180 msgr2=0x7f47bc14c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bbe00640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc155180 0x7f47bc14c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bbe00640 1 -- 172.21.15.149:0/881810417 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a400b6f0 con 0x7f47bc155550 2024-08-17T02:47:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47bbe00640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0c96a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f47b400ea80 tx=0x7f47b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400ca10 con 0x7f47bc155550 2024-08-17T02:47:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400cb70 con 0x7f47bc155550 2024-08-17T02:47:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4013470 con 0x7f47bc155550 2024-08-17T02:47:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.728+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0c88e0 con 0x7f47bc155550 2024-08-17T02:47:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.729+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0c8ea0 con 0x7f47bc155550 2024-08-17T02:47:47.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.730+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc064db0 con 0x7f47bc155550 2024-08-17T02:47:47.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.730+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47b4013820 con 0x7f47bc155550 2024-08-17T02:47:47.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.731+0000 7f47b3400640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4798065150 0x7f4798067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.731+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47b4082b00 con 0x7f47bc155550 2024-08-17T02:47:47.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.732+0000 7f47bb400640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4798065150 0x7f4798067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.732+0000 7f47bb400640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4798065150 0x7f4798067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47ac004290 tx=0x7f47ac001660 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.736+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f47b4084e60 con 0x7f47bc155550 2024-08-17T02:47:47.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.931+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f47bc0c9350 con 0x7f4798065150 2024-08-17T02:47:47.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.932+0000 7f47b3400640 1 -- 172.21.15.149:0/881810417 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f47bc0c9350 con 0x7f4798065150 2024-08-17T02:47:47.933 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2024-08-17T02:47:47.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:47.933 INFO:teuthology.orchestra.run.smithi149.stdout: "name": "cephfs" 2024-08-17T02:47:47.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:47.933 INFO:teuthology.orchestra.run.smithi149.stdout:] 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4798065150 msgr2=0x7f4798067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4798065150 0x7f4798067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47ac004290 tx=0x7f47ac001660 comp rx=0 tx=0).stop 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 msgr2=0x7f47bc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0c96a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f47b400ea80 tx=0x7f47b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 shutdown_connections 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4798065150 0x7f4798067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc155550 0x7f47bc0c96a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc155180 0x7f47bc14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 --2- 172.21.15.149:0/881810417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc06e080 0x7f47bc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.934+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 >> 172.21.15.149:0/881810417 conn(0x7f47bc0cb9b0 msgr2=0x7f47bc154490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.935+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 shutdown_connections 2024-08-17T02:47:47.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:47.935+0000 7f47c2200640 1 -- 172.21.15.149:0/881810417 wait complete. 2024-08-17T02:47:47.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:47:48.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.101+0000 7f3298a00640 1 Processor -- start 2024-08-17T02:47:48.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.102+0000 7f3298a00640 1 -- start start 2024-08-17T02:47:48.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3298a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32940adfb0 0x7f32940ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3298a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3294155a30 0x7f329406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3298a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940afc40 con 0x7f3294155660 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3298a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32940af030 con 0x7f3294155a30 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3298a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940af310 con 0x7f32940adfb0 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3293e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3294155a30 0x7f329406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3293e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3294155a30 0x7f329406dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42918/0 (socket says 172.21.15.149:42918) 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3293e00640 1 -- 172.21.15.149:0/1222932783 learned_addr learned my addr 172.21.15.149:0/1222932783 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3293400640 1 --1- 172.21.15.149:0/1222932783 >> v1:172.21.15.149:6789/0 conn(0x7f3294155660 0x7f32940c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37572/0 (socket says 172.21.15.149:37572) 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f328aa00640 1 --2- 172.21.15.149:0/1222932783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32940adfb0 0x7f32940ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.103+0000 7f3293e00640 1 -- 172.21.15.149:0/1222932783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32940adfb0 msgr2=0x7f32940ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.104+0000 7f3293e00640 1 --2- 172.21.15.149:0/1222932783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32940adfb0 0x7f32940ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.104+0000 7f3293e00640 1 -- 172.21.15.149:0/1222932783 >> v1:172.21.15.149:6789/0 conn(0x7f3294155660 legacy=0x7f32940c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.104+0000 7f3293e00640 1 -- 172.21.15.149:0/1222932783 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940af5f0 con 0x7f3294155a30 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3293e00640 1 --2- 172.21.15.149:0/1222932783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f329406dec0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f328c009f20 tx=0x7f328c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78a7bbc4b5bb163 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3292a00640 1 -- 172.21.15.149:0/1222932783 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c031400 con 0x7f3294155a30 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3292a00640 1 -- 172.21.15.149:0/1222932783 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c02d050 con 0x7f3294155a30 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3292a00640 1 -- 172.21.15.149:0/1222932783 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c0317d0 con 0x7f3294155a30 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3298a00640 1 -- 172.21.15.149:0/1222932783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 msgr2=0x7f329406dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3298a00640 1 --2- 172.21.15.149:0/1222932783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f329406dec0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f328c009f20 tx=0x7f328c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3298a00640 1 -- 172.21.15.149:0/1222932783 shutdown_connections 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3298a00640 1 --2- 172.21.15.149:0/1222932783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f329406dec0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3298a00640 1 --2- 172.21.15.149:0/1222932783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32940adfb0 0x7f32940ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.105+0000 7f3298a00640 1 -- 172.21.15.149:0/1222932783 >> 172.21.15.149:0/1222932783 conn(0x7f3294066cd0 msgr2=0x7f32940670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:48.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.106+0000 7f3298a00640 1 -- 172.21.15.149:0/1222932783 shutdown_connections 2024-08-17T02:47:48.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.106+0000 7f3298a00640 1 -- 172.21.15.149:0/1222932783 wait complete. 2024-08-17T02:47:48.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.107+0000 7f3298a00640 1 Processor -- start 2024-08-17T02:47:48.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.107+0000 7f3298a00640 1 -- start start 2024-08-17T02:47:48.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3298a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940adfb0 0x7f329415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3298a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294155660 0x7f3294158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3298a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f3294068560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3298a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294169d80 con 0x7f3294155a30 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3298a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329416a620 con 0x7f32940adfb0 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3298a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329415e290 con 0x7f3294155660 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3293e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f3294068560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3293e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f3294068560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42926/0 (socket says 172.21.15.149:42926) 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3293e00640 1 -- 172.21.15.149:0/2166696972 learned_addr learned my addr 172.21.15.149:0/2166696972 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f3293400640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940adfb0 0x7f329415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.108+0000 7f328aa00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294155660 0x7f3294158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3293e00640 1 -- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294155660 msgr2=0x7f3294158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3293e00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294155660 0x7f3294158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3293e00640 1 -- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940adfb0 msgr2=0x7f329415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3293e00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940adfb0 0x7f329415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3293e00640 1 -- 172.21.15.149:0/2166696972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c009ae0 con 0x7f3294155a30 2024-08-17T02:47:48.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3293e00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f3294068560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f328c009f80 tx=0x7f328c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c007760 con 0x7f3294155a30 2024-08-17T02:47:48.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c0078c0 con 0x7f3294155a30 2024-08-17T02:47:48.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294158f00 con 0x7f3294155a30 2024-08-17T02:47:48.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c007c80 con 0x7f3294155a30 2024-08-17T02:47:48.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.109+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329416a2b0 con 0x7f3294155a30 2024-08-17T02:47:48.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.110+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329416a7d0 con 0x7f3294155a30 2024-08-17T02:47:48.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.111+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f328c038070 con 0x7f3294155a30 2024-08-17T02:47:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.112+0000 7f328b400640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3270065180 0x7f3270067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.112+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f328c0a3350 con 0x7f3294155a30 2024-08-17T02:47:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.112+0000 7f3293400640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3270065180 0x7f3270067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.113+0000 7f3293400640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3270065180 0x7f3270067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f329416c110 tx=0x7f3284007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.117+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f329416a7d0 con 0x7f3294155a30 2024-08-17T02:47:48.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.290+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f329416a790 con 0x7f3294155a30 2024-08-17T02:47:48.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.291+0000 7f328b400640 1 -- 172.21.15.149:0/2166696972 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f328c071420 con 0x7f3294155a30 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3270065180 msgr2=0x7f3270067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3270065180 0x7f3270067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f329416c110 tx=0x7f3284007e20 comp rx=0 tx=0).stop 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 msgr2=0x7f3294068560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f3294068560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f328c009f80 tx=0x7f328c036000 comp rx=0 tx=0).stop 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 shutdown_connections 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3270065180 0x7f3270067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3294155a30 0x7f3294068560 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294155660 0x7f3294158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 --2- 172.21.15.149:0/2166696972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940adfb0 0x7f329415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 >> 172.21.15.149:0/2166696972 conn(0x7f3294066cd0 msgr2=0x7f32940aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 shutdown_connections 2024-08-17T02:47:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.293+0000 7f3298a00640 1 -- 172.21.15.149:0/2166696972 wait complete. 2024-08-17T02:47:48.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000066836 2024-08-17T02:47:48.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.459+0000 7f6963600640 1 Processor -- start 2024-08-17T02:47:48.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.459+0000 7f6963600640 1 -- start start 2024-08-17T02:47:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.460+0000 7f6963600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f695c0af2e0 0x7f695c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.460+0000 7f6963600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f695c0af6b0 0x7f695c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.460+0000 7f6963600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c156770 con 0x7f695c06dcf0 2024-08-17T02:47:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.460+0000 7f6963600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c06e110 con 0x7f695c0af2e0 2024-08-17T02:47:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.460+0000 7f6963600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c155b60 con 0x7f695c0af6b0 2024-08-17T02:47:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6960c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f695c0af2e0 0x7f695c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6961600640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f695c06dcf0 0x7f695c158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37580/0 (socket says 172.21.15.149:37580) 2024-08-17T02:47:48.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6961600640 1 -- 172.21.15.149:0/2973312581 learned_addr learned my addr 172.21.15.149:0/2973312581 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f695be00640 1 --2- 172.21.15.149:0/2973312581 >> v2:172.21.15.161:3300/0 conn(0x7f695c0af6b0 0x7f695c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6960c00640 1 -- 172.21.15.149:0/2973312581 >> v2:172.21.15.161:3300/0 conn(0x7f695c0af6b0 msgr2=0x7f695c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6960c00640 1 --2- 172.21.15.149:0/2973312581 >> v2:172.21.15.161:3300/0 conn(0x7f695c0af6b0 0x7f695c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6960c00640 1 -- 172.21.15.149:0/2973312581 >> v1:172.21.15.149:6789/0 conn(0x7f695c06dcf0 legacy=0x7f695c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f695b400640 1 -- 172.21.15.149:0/2973312581 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642521505 0 0) 0x7f695c156770 con 0x7f695c06dcf0 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.461+0000 7f6960c00640 1 -- 172.21.15.149:0/2973312581 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c155e40 con 0x7f695c0af2e0 2024-08-17T02:47:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.462+0000 7f6960c00640 1 --2- 172.21.15.149:0/2973312581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c0b1240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f695c06c570 tx=0x7f695000a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a4fdc3198fe216 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.462+0000 7f695b400640 1 -- 172.21.15.149:0/2973312581 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950030510 con 0x7f695c0af2e0 2024-08-17T02:47:48.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f695b400640 1 -- 172.21.15.149:0/2973312581 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695002e050 con 0x7f695c0af2e0 2024-08-17T02:47:48.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f695b400640 1 -- 172.21.15.149:0/2973312581 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500308a0 con 0x7f695c0af2e0 2024-08-17T02:47:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 -- 172.21.15.149:0/2973312581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 msgr2=0x7f695c0b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 --2- 172.21.15.149:0/2973312581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c0b1240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f695c06c570 tx=0x7f695000a2b0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 -- 172.21.15.149:0/2973312581 shutdown_connections 2024-08-17T02:47:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 --2- 172.21.15.149:0/2973312581 >> v2:172.21.15.161:3300/0 conn(0x7f695c0af6b0 0x7f695c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 --2- 172.21.15.149:0/2973312581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c0b1240 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 -- 172.21.15.149:0/2973312581 >> 172.21.15.149:0/2973312581 conn(0x7f695c067750 msgr2=0x7f695c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 -- 172.21.15.149:0/2973312581 shutdown_connections 2024-08-17T02:47:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.463+0000 7f6963600640 1 -- 172.21.15.149:0/2973312581 wait complete. 2024-08-17T02:47:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.465+0000 7f6963600640 1 Processor -- start 2024-08-17T02:47:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.465+0000 7f6963600640 1 -- start start 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6963600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c06dcf0 0x7f695c16a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6963600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6963600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c0af6b0 0x7f695c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6963600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c151ed0 con 0x7f695c0af2e0 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6963600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c150b70 con 0x7f695c0af6b0 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6963600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14ffa0 con 0x7f695c06dcf0 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42950/0 (socket says 172.21.15.149:42950) 2024-08-17T02:47:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 -- 172.21.15.149:0/252789630 learned_addr learned my addr 172.21.15.149:0/252789630 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6960c00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c06dcf0 0x7f695c16a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f6961600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c0af6b0 0x7f695c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 -- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c06dcf0 msgr2=0x7f695c16a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c06dcf0 0x7f695c16a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 -- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c0af6b0 msgr2=0x7f695c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c0af6b0 0x7f695c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.466+0000 7f695be00640 1 -- 172.21.15.149:0/252789630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695000a530 con 0x7f695c0af2e0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.467+0000 7f695be00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c151990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f694800d890 tx=0x7f6948008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.467+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480096a0 con 0x7f695c0af2e0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.467+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948009800 con 0x7f695c0af2e0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.467+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948009bc0 con 0x7f695c0af2e0 2024-08-17T02:47:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.467+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c150240 con 0x7f695c0af2e0 2024-08-17T02:47:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.467+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c150800 con 0x7f695c0af2e0 2024-08-17T02:47:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.468+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c071050 con 0x7f695c0af2e0 2024-08-17T02:47:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.469+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6948014620 con 0x7f695c0af2e0 2024-08-17T02:47:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.470+0000 7f694fe00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f693c065150 0x7f693c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.470+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6948082ca0 con 0x7f695c0af2e0 2024-08-17T02:47:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.470+0000 7f6960c00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f693c065150 0x7f693c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.471+0000 7f6960c00640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f693c065150 0x7f693c067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6950035000 tx=0x7f6950038000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.474+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6948050ed0 con 0x7f695c0af2e0 2024-08-17T02:47:48.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:48.673+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000066836", "target": ["mon-mgr", ""]}) v1 -- 0x7f695c0640d0 con 0x7f693c065150 2024-08-17T02:47:51.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.587+0000 7f694fe00640 1 -- 172.21.15.149:0/252789630 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f695c0640d0 con 0x7f693c065150 2024-08-17T02:47:51.588 INFO:teuthology.orchestra.run.smithi149.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:47:51.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.593+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f693c065150 msgr2=0x7f693c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.593+0000 7f6963600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f693c065150 0x7f693c067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6950035000 tx=0x7f6950038000 comp rx=0 tx=0).stop 2024-08-17T02:47:51.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.593+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 msgr2=0x7f695c151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.593+0000 7f6963600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c151990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f694800d890 tx=0x7f6948008040 comp rx=0 tx=0).stop 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.594+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 shutdown_connections 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.594+0000 7f6963600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f693c065150 0x7f693c067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.594+0000 7f6963600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c0af6b0 0x7f695c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.594+0000 7f6963600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c0af2e0 0x7f695c151990 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.594+0000 7f6963600640 1 --2- 172.21.15.149:0/252789630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c06dcf0 0x7f695c16a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.594+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 >> 172.21.15.149:0/252789630 conn(0x7f695c067750 msgr2=0x7f695c0693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.595+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 shutdown_connections 2024-08-17T02:47:51.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.595+0000 7f6963600640 1 -- 172.21.15.149:0/252789630 wait complete. 2024-08-17T02:47:51.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:47:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.768+0000 7f8f9ae00640 1 Processor -- start 2024-08-17T02:47:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.769+0000 7f8f9ae00640 1 -- start start 2024-08-17T02:47:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9ae00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f940cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9ae00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8f94156ea0 0x7f8f9406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9ae00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f940caaf0 con 0x7f8f9406dab0 2024-08-17T02:47:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9ae00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f940ca900 con 0x7f8f94156ea0 2024-08-17T02:47:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9ae00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940cc560 con 0x7f8f94156ad0 2024-08-17T02:47:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f99000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8f94156ea0 0x7f8f9406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9a400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8f9406dab0 0x7f8f940c8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37594/0 (socket says 172.21.15.149:37594) 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f9a400640 1 -- 172.21.15.149:0/3271043791 learned_addr learned my addr 172.21.15.149:0/3271043791 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.770+0000 7f8f99a00640 1 --2- 172.21.15.149:0/3271043791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f940cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.771+0000 7f8f99000640 1 -- 172.21.15.149:0/3271043791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 msgr2=0x7f8f940cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.771+0000 7f8f99000640 1 --2- 172.21.15.149:0/3271043791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f940cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.771+0000 7f8f99000640 1 -- 172.21.15.149:0/3271043791 >> v1:172.21.15.149:6789/0 conn(0x7f8f9406dab0 legacy=0x7f8f940c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.771+0000 7f8f99000640 1 -- 172.21.15.149:0/3271043791 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940cad90 con 0x7f8f94156ea0 2024-08-17T02:47:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f99000640 1 --2- 172.21.15.149:0/3271043791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f94156ea0 0x7f8f9406d570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009880 tx=0x7f8f800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11732688f83d524 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f93e00640 1 -- 172.21.15.149:0/3271043791 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8002ad90 con 0x7f8f94156ea0 2024-08-17T02:47:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f93e00640 1 -- 172.21.15.149:0/3271043791 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80032440 con 0x7f8f94156ea0 2024-08-17T02:47:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f93e00640 1 -- 172.21.15.149:0/3271043791 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80032820 con 0x7f8f94156ea0 2024-08-17T02:47:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 -- 172.21.15.149:0/3271043791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f94156ea0 msgr2=0x7f8f9406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/3271043791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f94156ea0 0x7f8f9406d570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009880 tx=0x7f8f800090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 -- 172.21.15.149:0/3271043791 shutdown_connections 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/3271043791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f94156ea0 0x7f8f9406d570 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/3271043791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f940cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 -- 172.21.15.149:0/3271043791 >> 172.21.15.149:0/3271043791 conn(0x7f8f94067750 msgr2=0x7f8f940cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 -- 172.21.15.149:0/3271043791 shutdown_connections 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.772+0000 7f8f9ae00640 1 -- 172.21.15.149:0/3271043791 wait complete. 2024-08-17T02:47:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.774+0000 7f8f9ae00640 1 Processor -- start 2024-08-17T02:47:51.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.774+0000 7f8f9ae00640 1 -- start start 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 0x7f8f9414f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9ae00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f9414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9ae00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f94156ea0 0x7f8f9414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940b0250 con 0x7f8f9406dab0 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9ae00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940af640 con 0x7f8f94156ea0 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9ae00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940af920 con 0x7f8f94156ad0 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 0x7f8f9414f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 0x7f8f9414f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42956/0 (socket says 172.21.15.149:42956) 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 -- 172.21.15.149:0/2365254134 learned_addr learned my addr 172.21.15.149:0/2365254134 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f9a400640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f94156ea0 0x7f8f9414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99000640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f9414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 -- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 msgr2=0x7f8f9414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f9414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 -- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f94156ea0 msgr2=0x7f8f9414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f94156ea0 0x7f8f9414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.775+0000 7f8f99a00640 1 -- 172.21.15.149:0/2365254134 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80009390 con 0x7f8f9406dab0 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f9a400640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f94156ea0 0x7f8f9414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f99000640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f9414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f99a00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 0x7f8f9414f400 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800ea20 tx=0x7f8f880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800ca10 con 0x7f8f9406dab0 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800cb70 con 0x7f8f9406dab0 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f940afc00 con 0x7f8f9406dab0 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88013470 con 0x7f8f9406dab0 2024-08-17T02:47:51.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.776+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f940b06e0 con 0x7f8f9406dab0 2024-08-17T02:47:51.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.777+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f94071050 con 0x7f8f9406dab0 2024-08-17T02:47:51.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.778+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8f88013860 con 0x7f8f9406dab0 2024-08-17T02:47:51.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.779+0000 7f8f90c00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8f74065150 0x7f8f74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.779+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8f88082c00 con 0x7f8f9406dab0 2024-08-17T02:47:51.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.779+0000 7f8f99000640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8f74065150 0x7f8f74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.780+0000 7f8f99000640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8f74065150 0x7f8f74067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f80034000 tx=0x7f8f80032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.783+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8f880508a0 con 0x7f8f9406dab0 2024-08-17T02:47:51.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.979+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f940b0390 con 0x7f8f74065150 2024-08-17T02:47:51.981 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.980+0000 7f8f90c00640 1 -- 172.21.15.149:0/2365254134 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f8f80032690 con 0x7f8f74065150 2024-08-17T02:47:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2024-08-17T02:47:51.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:51.981 INFO:teuthology.orchestra.run.smithi149.stdout: "name": "cephfs" 2024-08-17T02:47:51.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-08-17T02:47:51.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-08-17T02:47:51.982 INFO:teuthology.orchestra.run.smithi149.stdout: "name": "volume_0000000000066836" 2024-08-17T02:47:51.982 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-08-17T02:47:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:] 2024-08-17T02:47:51.984 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8f74065150 msgr2=0x7f8f74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.984 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8f74065150 0x7f8f74067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f80034000 tx=0x7f8f80032000 comp rx=0 tx=0).stop 2024-08-17T02:47:51.984 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 msgr2=0x7f8f9414f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 0x7f8f9414f400 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800ea20 tx=0x7f8f880090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 shutdown_connections 2024-08-17T02:47:51.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8f74065150 0x7f8f74067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f94156ea0 0x7f8f9414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f94156ad0 0x7f8f9414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 --2- 172.21.15.149:0/2365254134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9406dab0 0x7f8f9414f400 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 >> 172.21.15.149:0/2365254134 conn(0x7f8f94067750 msgr2=0x7f8f94068920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 shutdown_connections 2024-08-17T02:47:51.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:51.982+0000 7f8f9ae00640 1 -- 172.21.15.149:0/2365254134 wait complete. 2024-08-17T02:47:51.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:47:52.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.150+0000 7fb484a00640 1 Processor -- start 2024-08-17T02:47:52.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.150+0000 7fb484a00640 1 -- start start 2024-08-17T02:47:52.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb484a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159b90 0x7fb4800ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb484a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4800ca8a0 0x7fb4800cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb484a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cadc0 con 0x7fb480159f60 2024-08-17T02:47:52.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb484a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800cb880 con 0x7fb4800ca8a0 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb484a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cd6e0 con 0x7fb480159b90 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb475e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4800ca8a0 0x7fb4800cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb475e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4800ca8a0 0x7fb4800cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42970/0 (socket says 172.21.15.149:42970) 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb475e00640 1 -- 172.21.15.149:0/910688603 learned_addr learned my addr 172.21.15.149:0/910688603 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb47f200640 1 --1- 172.21.15.149:0/910688603 >> v1:172.21.15.149:6789/0 conn(0x7fb480159f60 0x7fb4800cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37608/0 (socket says 172.21.15.149:37608) 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.151+0000 7fb47e800640 1 --2- 172.21.15.149:0/910688603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159b90 0x7fb4800ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.152+0000 7fb475e00640 1 -- 172.21.15.149:0/910688603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159b90 msgr2=0x7fb4800ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.152+0000 7fb475e00640 1 --2- 172.21.15.149:0/910688603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159b90 0x7fb4800ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.152+0000 7fb475e00640 1 -- 172.21.15.149:0/910688603 >> v1:172.21.15.149:6789/0 conn(0x7fb480159f60 legacy=0x7fb4800cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.152+0000 7fb475e00640 1 -- 172.21.15.149:0/910688603 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800cb060 con 0x7fb4800ca8a0 2024-08-17T02:47:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.152+0000 7fb475e00640 1 --2- 172.21.15.149:0/910688603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb4800cc590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb468009910 tx=0x7fb4680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2778da0c41e11d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb47de00640 1 -- 172.21.15.149:0/910688603 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46802ae40 con 0x7fb4800ca8a0 2024-08-17T02:47:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb47de00640 1 -- 172.21.15.149:0/910688603 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468032440 con 0x7fb4800ca8a0 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb47de00640 1 -- 172.21.15.149:0/910688603 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468032820 con 0x7fb4800ca8a0 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 -- 172.21.15.149:0/910688603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 msgr2=0x7fb4800cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 --2- 172.21.15.149:0/910688603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb4800cc590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb468009910 tx=0x7fb4680091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 -- 172.21.15.149:0/910688603 shutdown_connections 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 --2- 172.21.15.149:0/910688603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb4800cc590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 --2- 172.21.15.149:0/910688603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159b90 0x7fb4800ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 -- 172.21.15.149:0/910688603 >> 172.21.15.149:0/910688603 conn(0x7fb480098e00 msgr2=0x7fb48006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.153+0000 7fb484a00640 1 -- 172.21.15.149:0/910688603 shutdown_connections 2024-08-17T02:47:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.154+0000 7fb484a00640 1 -- 172.21.15.149:0/910688603 wait complete. 2024-08-17T02:47:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.155+0000 7fb484a00640 1 Processor -- start 2024-08-17T02:47:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.155+0000 7fb484a00640 1 -- start start 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb484a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb480156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb484a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480159b90 0x7fb4800c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb484a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159f60 0x7fb4800c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb484a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b41a0 con 0x7fb4800ca8a0 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb484a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b4440 con 0x7fb480159b90 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb484a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b4720 con 0x7fb480159f60 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb480156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb480156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42976/0 (socket says 172.21.15.149:42976) 2024-08-17T02:47:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 -- 172.21.15.149:0/1526184839 learned_addr learned my addr 172.21.15.149:0/1526184839 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb475e00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480159b90 0x7fb4800c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47f200640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159f60 0x7fb4800c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 -- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159f60 msgr2=0x7fb4800c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159f60 0x7fb4800c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 -- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480159b90 msgr2=0x7fb4800c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480159b90 0x7fb4800c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb47e800640 1 -- 172.21.15.149:0/1526184839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468009450 con 0x7fb4800ca8a0 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.156+0000 7fb475e00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480159b90 0x7fb4800c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb47f200640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159f60 0x7fb4800c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb47e800640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb480156010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb47000ea20 tx=0x7fb4700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000ca10 con 0x7fb4800ca8a0 2024-08-17T02:47:52.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47000cb70 con 0x7fb4800ca8a0 2024-08-17T02:47:52.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470013470 con 0x7fb4800ca8a0 2024-08-17T02:47:52.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4800b4a00 con 0x7fb4800ca8a0 2024-08-17T02:47:52.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.157+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800b4fc0 con 0x7fb4800ca8a0 2024-08-17T02:47:52.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.158+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb480063e90 con 0x7fb4800ca8a0 2024-08-17T02:47:52.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.159+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb470013860 con 0x7fb4800ca8a0 2024-08-17T02:47:52.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.160+0000 7fb476a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb45c0651d0 0x7fb45c067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.160+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb470082b60 con 0x7fb4800ca8a0 2024-08-17T02:47:52.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.160+0000 7fb475e00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb45c0651d0 0x7fb45c067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.161+0000 7fb475e00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb45c0651d0 0x7fb45c067680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb468034000 tx=0x7fb468032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.164+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb480063e90 con 0x7fb4800ca8a0 2024-08-17T02:47:52.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.333+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fb480063e90 con 0x7fb4800ca8a0 2024-08-17T02:47:52.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.334+0000 7fb476a00640 1 -- 172.21.15.149:0/1526184839 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v37) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fb480063e90 con 0x7fb4800ca8a0 2024-08-17T02:47:52.334 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:52.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb45c0651d0 msgr2=0x7fb45c067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb45c0651d0 0x7fb45c067680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb468034000 tx=0x7fb468032000 comp rx=0 tx=0).stop 2024-08-17T02:47:52.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 msgr2=0x7fb480156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb480156010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb47000ea20 tx=0x7fb4700090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 shutdown_connections 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb45c0651d0 0x7fb45c067680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480159f60 0x7fb4800c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480159b90 0x7fb4800c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 --2- 172.21.15.149:0/1526184839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4800ca8a0 0x7fb480156010 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 >> 172.21.15.149:0/1526184839 conn(0x7fb480098e00 msgr2=0x7fb4800673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 shutdown_connections 2024-08-17T02:47:52.338 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.336+0000 7fb484a00640 1 -- 172.21.15.149:0/1526184839 wait complete. 2024-08-17T02:47:52.352 INFO:teuthology.orchestra.run.smithi149.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}] 2024-08-17T02:47:52.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000066836 --format=json 2024-08-17T02:47:52.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.502+0000 7f9320400640 1 Processor -- start 2024-08-17T02:47:52.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.502+0000 7f9320400640 1 -- start start 2024-08-17T02:47:52.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.503+0000 7f9320400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93181401b0 0x7f93180caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f9320400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180caa80 con 0x7f9318140580 2024-08-17T02:47:52.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f9320400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180c9e70 con 0x7f93180b1440 2024-08-17T02:47:52.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f9320400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93180cb450 con 0x7f93181401b0 2024-08-17T02:47:52.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93181401b0 0x7f93180caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931d000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9318140580 0x7f93180b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37624/0 (socket says 172.21.15.149:37624) 2024-08-17T02:47:52.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931d000640 1 -- 172.21.15.149:0/1357885686 learned_addr learned my addr 172.21.15.149:0/1357885686 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:52.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93181401b0 0x7f93180caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42978/0 (socket says 172.21.15.149:42978) 2024-08-17T02:47:52.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931da00640 1 -- 172.21.15.149:0/1357885686 >> v1:172.21.15.161:6789/0 conn(0x7f93180b1440 legacy=0x7f93180c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:52.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931da00640 1 -- 172.21.15.149:0/1357885686 >> v1:172.21.15.149:6789/0 conn(0x7f9318140580 legacy=0x7f93180b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f931da00640 1 -- 172.21.15.149:0/1357885686 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93180ca150 con 0x7f93181401b0 2024-08-17T02:47:52.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.504+0000 7f9317e00640 1 -- 172.21.15.149:0/1357885686 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588036004 0 0) 0x7f93180caa80 con 0x7f9318140580 2024-08-17T02:47:52.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.505+0000 7f931da00640 1 --2- 172.21.15.149:0/1357885686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f93180caf10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f930c009850 tx=0x7f930c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62aa4ac92980268d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9317e00640 1 -- 172.21.15.149:0/1357885686 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c02ad00 con 0x7f93181401b0 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9317e00640 1 -- 172.21.15.149:0/1357885686 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c02ae60 con 0x7f93181401b0 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9317e00640 1 -- 172.21.15.149:0/1357885686 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c032670 con 0x7f93181401b0 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 -- 172.21.15.149:0/1357885686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 msgr2=0x7f93180caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 --2- 172.21.15.149:0/1357885686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f93180caf10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f930c009850 tx=0x7f930c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 -- 172.21.15.149:0/1357885686 shutdown_connections 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 --2- 172.21.15.149:0/1357885686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f93180caf10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 -- 172.21.15.149:0/1357885686 >> 172.21.15.149:0/1357885686 conn(0x7f93180cb9b0 msgr2=0x7f93180cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 -- 172.21.15.149:0/1357885686 shutdown_connections 2024-08-17T02:47:52.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.506+0000 7f9320400640 1 -- 172.21.15.149:0/1357885686 wait complete. 2024-08-17T02:47:52.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.508+0000 7f9320400640 1 Processor -- start 2024-08-17T02:47:52.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.508+0000 7f9320400640 1 -- start start 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f9320400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93180b1440 0x7f93180aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f9320400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f9318169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f9320400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9318140580 0x7f93181698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f9320400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93180b0260 con 0x7f93181401b0 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f9320400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93180c7960 con 0x7f9318140580 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f9320400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93180af5e0 con 0x7f93180b1440 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f9318169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931da00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93180b1440 0x7f93180aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f9318169360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42986/0 (socket says 172.21.15.149:42986) 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 -- 172.21.15.149:0/968911416 learned_addr learned my addr 172.21.15.149:0/968911416 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931e400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9318140580 0x7f93181698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 -- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93180b1440 msgr2=0x7f93180aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93180b1440 0x7f93180aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 -- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9318140580 msgr2=0x7f93181698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9318140580 0x7f93181698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.509+0000 7f931d000640 1 -- 172.21.15.149:0/968911416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c009390 con 0x7f93181401b0 2024-08-17T02:47:52.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.510+0000 7f931d000640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f9318169360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f930400c5e0 tx=0x7f9304007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.510+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304005aa0 con 0x7f93181401b0 2024-08-17T02:47:52.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.510+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304005c00 con 0x7f93181401b0 2024-08-17T02:47:52.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.510+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93040070f0 con 0x7f93181401b0 2024-08-17T02:47:52.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.510+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93180af8c0 con 0x7f93181401b0 2024-08-17T02:47:52.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.510+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93180afe80 con 0x7f93181401b0 2024-08-17T02:47:52.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.511+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93180b03a0 con 0x7f93181401b0 2024-08-17T02:47:52.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.512+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9304007520 con 0x7f93181401b0 2024-08-17T02:47:52.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.513+0000 7f9314c00640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92f8065180 0x7f92f8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.513+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f93040821b0 con 0x7f93181401b0 2024-08-17T02:47:52.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.513+0000 7f931da00640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92f8065180 0x7f92f8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.514+0000 7f931da00640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92f8065180 0x7f92f8067630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f930c034000 tx=0x7f930c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.517+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93180b03a0 con 0x7f93181401b0 2024-08-17T02:47:52.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.737+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000066836", "format": "json"} v 0) v1 -- 0x7f93180b03a0 con 0x7f93181401b0 2024-08-17T02:47:52.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.738+0000 7f9314c00640 1 -- 172.21.15.149:0/968911416 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000066836", "format": "json"}]=0 v21) v1 ==== 110+0+1844 (secure 0 0 0) 0x7f93180b03a0 con 0x7f93181401b0 2024-08-17T02:47:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:47:52.739 INFO:teuthology.orchestra.run.smithi149.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92f8065180 msgr2=0x7f92f8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92f8065180 0x7f92f8067630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f930c034000 tx=0x7f930c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 msgr2=0x7f9318169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f9318169360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f930400c5e0 tx=0x7f9304007d60 comp rx=0 tx=0).stop 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 shutdown_connections 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f92f8065180 0x7f92f8067630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9318140580 0x7f93181698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93181401b0 0x7f9318169360 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 --2- 172.21.15.149:0/968911416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93180b1440 0x7f93180aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 >> 172.21.15.149:0/968911416 conn(0x7f93180cb9b0 msgr2=0x7f93180a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 shutdown_connections 2024-08-17T02:47:52.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.740+0000 7f9320400640 1 -- 172.21.15.149:0/968911416 wait complete. 2024-08-17T02:47:52.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000066836 --yes-i-really-mean-it 2024-08-17T02:47:52.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.910+0000 7f49fc400640 1 Processor -- start 2024-08-17T02:47:52.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.910+0000 7f49fc400640 1 -- start start 2024-08-17T02:47:52.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.911+0000 7f49fc400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49f40c8bd0 0x7f49f40c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.911+0000 7f49fc400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40ab130 con 0x7f49f40adcf0 2024-08-17T02:47:52.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.911+0000 7f49fc400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40c9530 con 0x7f49f4156c50 2024-08-17T02:47:52.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.911+0000 7f49fc400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40ae5a0 con 0x7f49f40c8bd0 2024-08-17T02:47:52.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49f9000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f49f40adcf0 0x7f49f40ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:37626/0 (socket says 172.21.15.149:37626) 2024-08-17T02:47:52.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49f9000640 1 -- 172.21.15.149:0/3649813321 learned_addr learned my addr 172.21.15.149:0/3649813321 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:47:52.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49fa400640 1 --2- 172.21.15.149:0/3649813321 >> v2:172.21.15.161:3300/0 conn(0x7f49f40c8bd0 0x7f49f40c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49f3e00640 1 -- 172.21.15.149:0/3649813321 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052482753 0 0) 0x7f49f40ab130 con 0x7f49f40adcf0 2024-08-17T02:47:52.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49f3e00640 1 -- 172.21.15.149:0/3649813321 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49dc0034e0 con 0x7f49f40adcf0 2024-08-17T02:47:52.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49fa400640 1 -- 172.21.15.149:0/3649813321 >> v1:172.21.15.161:6789/0 conn(0x7f49f4156c50 legacy=0x7f49f40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49fa400640 1 -- 172.21.15.149:0/3649813321 >> v1:172.21.15.149:6789/0 conn(0x7f49f40adcf0 legacy=0x7f49f40ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.912+0000 7f49fa400640 1 -- 172.21.15.149:0/3649813321 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40ae2c0 con 0x7f49f40c8bd0 2024-08-17T02:47:52.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.913+0000 7f49fa400640 1 --2- 172.21.15.149:0/3649813321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40c8bd0 0x7f49f40c8ff0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009e60 tx=0x7f49ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3804cb4b256b2316 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.914+0000 7f49f3e00640 1 -- 172.21.15.149:0/3649813321 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec007550 con 0x7f49f40c8bd0 2024-08-17T02:47:52.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.914+0000 7f49f3e00640 1 -- 172.21.15.149:0/3649813321 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec02d050 con 0x7f49f40c8bd0 2024-08-17T02:47:52.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.914+0000 7f49f3e00640 1 -- 172.21.15.149:0/3649813321 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0078e0 con 0x7f49f40c8bd0 2024-08-17T02:47:52.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 -- 172.21.15.149:0/3649813321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40c8bd0 msgr2=0x7f49f40c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 --2- 172.21.15.149:0/3649813321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40c8bd0 0x7f49f40c8ff0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009e60 tx=0x7f49ec009780 comp rx=0 tx=0).stop 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 -- 172.21.15.149:0/3649813321 shutdown_connections 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 --2- 172.21.15.149:0/3649813321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40c8bd0 0x7f49f40c8ff0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 -- 172.21.15.149:0/3649813321 >> 172.21.15.149:0/3649813321 conn(0x7f49f4067750 msgr2=0x7f49f40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 -- 172.21.15.149:0/3649813321 shutdown_connections 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.915+0000 7f49fc400640 1 -- 172.21.15.149:0/3649813321 wait complete. 2024-08-17T02:47:52.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.916+0000 7f49fc400640 1 Processor -- start 2024-08-17T02:47:52.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.916+0000 7f49fc400640 1 -- start start 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49fc400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40adcf0 0x7f49f41529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49fc400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f40c8bd0 0x7f49f4155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49fc400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49f4156c50 0x7f49f414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49fc400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f414fb30 con 0x7f49f40c8bd0 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49fc400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f41531d0 con 0x7f49f40adcf0 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49fc400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4152f10 con 0x7f49f4156c50 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49f9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f40c8bd0 0x7f49f4155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49f9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f40c8bd0 0x7f49f4155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43002/0 (socket says 172.21.15.149:43002) 2024-08-17T02:47:52.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.917+0000 7f49f9000640 1 -- 172.21.15.149:0/3934828499 learned_addr learned my addr 172.21.15.149:0/3934828499 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9a00640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40adcf0 0x7f49f41529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49fa400640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49f4156c50 0x7f49f414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9000640 1 -- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49f4156c50 msgr2=0x7f49f414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9000640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49f4156c50 0x7f49f414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9000640 1 -- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40adcf0 msgr2=0x7f49f41529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9000640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40adcf0 0x7f49f41529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9000640 1 -- 172.21.15.149:0/3934828499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec009a20 con 0x7f49f40c8bd0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9a00640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49f40adcf0 0x7f49f41529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f9000640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f40c8bd0 0x7f49f4155050 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49e000c5e0 tx=0x7f49e0007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f0c00640 1 -- 172.21.15.149:0/3934828499 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0005b70 con 0x7f49f40c8bd0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f0c00640 1 -- 172.21.15.149:0/3934828499 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e0005cf0 con 0x7f49f40c8bd0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49fc400640 1 -- 172.21.15.149:0/3934828499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f4157150 con 0x7f49f40c8bd0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.918+0000 7f49f0c00640 1 -- 172.21.15.149:0/3934828499 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0005ea0 con 0x7f49f40c8bd0 2024-08-17T02:47:52.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.919+0000 7f49fc400640 1 -- 172.21.15.149:0/3934828499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4157710 con 0x7f49f40c8bd0 2024-08-17T02:47:52.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.920+0000 7f49fc400640 1 -- 172.21.15.149:0/3934828499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f4071050 con 0x7f49f40c8bd0 2024-08-17T02:47:52.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.920+0000 7f49f0c00640 1 -- 172.21.15.149:0/3934828499 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f49e001b400 con 0x7f49f40c8bd0 2024-08-17T02:47:52.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.921+0000 7f49f0c00640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49d4065150 0x7f49d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.921+0000 7f49f0c00640 1 -- 172.21.15.149:0/3934828499 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f49e00822c0 con 0x7f49f40c8bd0 2024-08-17T02:47:52.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.921+0000 7f49f9a00640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49d4065150 0x7f49d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.922+0000 7f49f9a00640 1 --2- 172.21.15.149:0/3934828499 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f49d4065150 0x7f49d4067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f49e8001780 tx=0x7f49e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:52.925+0000 7f49f0c00640 1 -- 172.21.15.149:0/3934828499 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f49e004ffe0 con 0x7f49f40c8bd0 2024-08-17T02:47:53.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:47:53.120+0000 7f49fc400640 1 -- 172.21.15.149:0/3934828499 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000066836", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f40c89b0 con 0x7f49d4065150 2024-08-17T02:47:57.344 INFO:tasks.ceph.mds.a.smithi149.stderr:2024-08-17T02:47:57.343+0000 7f5299400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:48:09.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:09.740 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:39.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:39.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:09.930 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:09.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:40.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:40.035 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:52.826 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:49:52.827 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:49:52.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:49:52.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:49:53.032 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:49:53.033 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:49:53.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:49:53.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:49:53.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:49:53.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:53.101 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:49:53.137 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:49:53.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:49:53.138 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:49:53.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:49:53.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:53.204 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:49:53.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:53.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.389+0000 7efcf9000640 1 Processor -- start 2024-08-17T02:49:53.390 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.389+0000 7efcf9000640 1 -- start start 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf9000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcf4140580 0x7efcf40c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf9000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40caa80 con 0x7efcf41401b0 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf9000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c9e70 con 0x7efcf40b1440 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf9000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40c9c90 con 0x7efcf4140580 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf1e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7efcf41401b0 0x7efcf40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34332/0 (socket says 172.21.15.149:34332) 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf1e00640 1 -- 172.21.15.149:0/2736214126 learned_addr learned my addr 172.21.15.149:0/2736214126 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:53.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.390+0000 7efcf2800640 1 --2- 172.21.15.149:0/2736214126 >> v2:172.21.15.161:3300/0 conn(0x7efcf4140580 0x7efcf40c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792914725 0 0) 0x7efcf40caa80 con 0x7efcf41401b0 2024-08-17T02:49:53.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd80034e0 con 0x7efcf41401b0 2024-08-17T02:49:53.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411730316 0 0) 0x7efcf40c9e70 con 0x7efcf40b1440 2024-08-17T02:49:53.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf40caa80 con 0x7efcf40b1440 2024-08-17T02:49:53.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf2800640 1 -- 172.21.15.149:0/2736214126 >> v1:172.21.15.161:6789/0 conn(0x7efcf40b1440 legacy=0x7efcf40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf2800640 1 -- 172.21.15.149:0/2736214126 >> v1:172.21.15.149:6789/0 conn(0x7efcf41401b0 legacy=0x7efcf40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.391+0000 7efcf2800640 1 -- 172.21.15.149:0/2736214126 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40ca150 con 0x7efcf4140580 2024-08-17T02:49:53.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.392+0000 7efcf2800640 1 --2- 172.21.15.149:0/2736214126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf4140580 0x7efcf40c9750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efcec009e60 tx=0x7efcec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ec8d8880ce80a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.392+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec007550 con 0x7efcf4140580 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.392+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec02d050 con 0x7efcf4140580 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.392+0000 7efcf0a00640 1 -- 172.21.15.149:0/2736214126 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec007900 con 0x7efcf4140580 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 -- 172.21.15.149:0/2736214126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf4140580 msgr2=0x7efcf40c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 --2- 172.21.15.149:0/2736214126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf4140580 0x7efcf40c9750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efcec009e60 tx=0x7efcec009780 comp rx=0 tx=0).stop 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 -- 172.21.15.149:0/2736214126 shutdown_connections 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 --2- 172.21.15.149:0/2736214126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf4140580 0x7efcf40c9750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 -- 172.21.15.149:0/2736214126 >> 172.21.15.149:0/2736214126 conn(0x7efcf40cb9b0 msgr2=0x7efcf40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:53.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 -- 172.21.15.149:0/2736214126 shutdown_connections 2024-08-17T02:49:53.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.393+0000 7efcf9000640 1 -- 172.21.15.149:0/2736214126 wait complete. 2024-08-17T02:49:53.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.394+0000 7efcf9000640 1 Processor -- start 2024-08-17T02:49:53.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 -- start start 2024-08-17T02:49:53.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf40b1440 0x7efcf40c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41401b0 0x7efcf40c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 0x7efcf40a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c7040 con 0x7efcf4140580 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c7320 con 0x7efcf41401b0 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.395+0000 7efcf9000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c7600 con 0x7efcf40b1440 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 0x7efcf40a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 0x7efcf40a5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39960/0 (socket says 172.21.15.149:39960) 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 -- 172.21.15.149:0/4255440692 learned_addr learned my addr 172.21.15.149:0/4255440692 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf1e00640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf40b1440 0x7efcf40c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf1400640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41401b0 0x7efcf40c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 -- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf40b1440 msgr2=0x7efcf40c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf40b1440 0x7efcf40c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 -- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41401b0 msgr2=0x7efcf40c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41401b0 0x7efcf40c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.396+0000 7efcf2800640 1 -- 172.21.15.149:0/4255440692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009a20 con 0x7efcf4140580 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.397+0000 7efcf2800640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 0x7efcf40a5f30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcec0097c0 tx=0x7efcec037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.397+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec041070 con 0x7efcf4140580 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.397+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec031ac0 con 0x7efcf4140580 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.397+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec031ea0 con 0x7efcf4140580 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.397+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf40c78e0 con 0x7efcf4140580 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.397+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf40c80e0 con 0x7efcf4140580 2024-08-17T02:49:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.398+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40c82d0 con 0x7efcf4140580 2024-08-17T02:49:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.399+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efcec003040 con 0x7efcf4140580 2024-08-17T02:49:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.400+0000 7efce9600640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcd4065150 0x7efcd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.400+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7efcec0a3700 con 0x7efcf4140580 2024-08-17T02:49:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.400+0000 7efcf1e00640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcd4065150 0x7efcd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.400+0000 7efcf1e00640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcd4065150 0x7efcd4067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efcf406b2d0 tx=0x7efce4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:53.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.404+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efcec071450 con 0x7efcf4140580 2024-08-17T02:49:53.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.615+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcf40c7de0 con 0x7efcf4140580 2024-08-17T02:49:53.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.615+0000 7efce9600640 1 -- 172.21.15.149:0/4255440692 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7efcec074a70 con 0x7efcf4140580 2024-08-17T02:49:53.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:53.617 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:37.896789+0000","modified":"2024-08-17T02:47:41.522751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4870":{"gid":4870,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/807513628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":807513628},{"type":"v1","addr":"172.21.15.161:6835","nonce":807513628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:53.617 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 21 2024-08-17T02:49:53.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcd4065150 msgr2=0x7efcd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcd4065150 0x7efcd4067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efcf406b2d0 tx=0x7efce4009040 comp rx=0 tx=0).stop 2024-08-17T02:49:53.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 msgr2=0x7efcf40a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 0x7efcf40a5f30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcec0097c0 tx=0x7efcec037000 comp rx=0 tx=0).stop 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 shutdown_connections 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcd4065150 0x7efcd4067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf4140580 0x7efcf40a5f30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41401b0 0x7efcf40c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 --2- 172.21.15.149:0/4255440692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf40b1440 0x7efcf40c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 >> 172.21.15.149:0/4255440692 conn(0x7efcf40cb9b0 msgr2=0x7efcf40c1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 shutdown_connections 2024-08-17T02:49:53.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.618+0000 7efcf9000640 1 -- 172.21.15.149:0/4255440692 wait complete. 2024-08-17T02:49:53.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:53.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.782+0000 7f3066200640 1 Processor -- start 2024-08-17T02:49:53.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.782+0000 7f3066200640 1 -- start start 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.783+0000 7f3066200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f306006df00 0x7f30600adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.783+0000 7f3066200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3060155df0 0x7f30600ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f3066200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3060156670 con 0x7f3060155a20 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f3066200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600b0350 con 0x7f306006df00 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f3066200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306006e5e0 con 0x7f3060155df0 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305f400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3060155a20 0x7f306006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34334/0 (socket says 172.21.15.149:34334) 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305f400640 1 -- 172.21.15.149:0/2920845204 learned_addr learned my addr 172.21.15.149:0/2920845204 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305ea00640 1 --2- 172.21.15.149:0/2920845204 >> v2:172.21.15.149:3300/0 conn(0x7f306006df00 0x7f30600adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305fe00640 1 --2- 172.21.15.149:0/2920845204 >> v2:172.21.15.161:3300/0 conn(0x7f3060155df0 0x7f30600ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305e000640 1 -- 172.21.15.149:0/2920845204 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979560489 0 0) 0x7f3060156670 con 0x7f3060155a20 2024-08-17T02:49:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305e000640 1 -- 172.21.15.149:0/2920845204 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440034e0 con 0x7f3060155a20 2024-08-17T02:49:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305ea00640 1 -- 172.21.15.149:0/2920845204 >> v2:172.21.15.161:3300/0 conn(0x7f3060155df0 msgr2=0x7f30600ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305ea00640 1 --2- 172.21.15.149:0/2920845204 >> v2:172.21.15.161:3300/0 conn(0x7f3060155df0 0x7f30600ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305ea00640 1 -- 172.21.15.149:0/2920845204 >> v1:172.21.15.149:6789/0 conn(0x7f3060155a20 legacy=0x7f306006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.784+0000 7f305ea00640 1 -- 172.21.15.149:0/2920845204 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306006e8c0 con 0x7f306006df00 2024-08-17T02:49:53.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.785+0000 7f305ea00640 1 --2- 172.21.15.149:0/2920845204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600adf10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f30600b0710 tx=0x7f304c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d379c803f2914691 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:53.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f305e000640 1 -- 172.21.15.149:0/2920845204 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c02ad20 con 0x7f306006df00 2024-08-17T02:49:53.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f305e000640 1 -- 172.21.15.149:0/2920845204 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c02ae80 con 0x7f306006df00 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f305e000640 1 -- 172.21.15.149:0/2920845204 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c032670 con 0x7f306006df00 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 -- 172.21.15.149:0/2920845204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 msgr2=0x7f30600adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 --2- 172.21.15.149:0/2920845204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600adf10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f30600b0710 tx=0x7f304c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 -- 172.21.15.149:0/2920845204 shutdown_connections 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 --2- 172.21.15.149:0/2920845204 >> v2:172.21.15.161:3300/0 conn(0x7f3060155df0 0x7f30600ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 --2- 172.21.15.149:0/2920845204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600adf10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 -- 172.21.15.149:0/2920845204 >> 172.21.15.149:0/2920845204 conn(0x7f30600cb9b0 msgr2=0x7f30600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 -- 172.21.15.149:0/2920845204 shutdown_connections 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.786+0000 7f3066200640 1 -- 172.21.15.149:0/2920845204 wait complete. 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.788+0000 7f3066200640 1 Processor -- start 2024-08-17T02:49:53.792 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.788+0000 7f3066200640 1 -- start start 2024-08-17T02:49:53.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f3066200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f3066200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3060155a20 0x7f30600a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f3066200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3060155df0 0x7f30600c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f3066200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3060151000 con 0x7f306006df00 2024-08-17T02:49:53.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f3066200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600cb810 con 0x7f3060155a20 2024-08-17T02:49:53.793 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f3066200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600ab0d0 con 0x7f3060155df0 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39976/0 (socket says 172.21.15.149:39976) 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 -- 172.21.15.149:0/822967776 learned_addr learned my addr 172.21.15.149:0/822967776 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305fe00640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3060155df0 0x7f30600c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305ea00640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3060155a20 0x7f30600a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 -- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3060155df0 msgr2=0x7f30600c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3060155df0 0x7f30600c13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 -- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3060155a20 msgr2=0x7f30600a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3060155a20 0x7f30600a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.794 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305f400640 1 -- 172.21.15.149:0/822967776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c009390 con 0x7f306006df00 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.789+0000 7f305ea00640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3060155a20 0x7f30600a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.790+0000 7f305f400640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600cb2d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f305000c5b0 tx=0x7f3050007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.790+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050005b70 con 0x7f306006df00 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.790+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050005cf0 con 0x7f306006df00 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.790+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30600aa030 con 0x7f306006df00 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.790+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050007340 con 0x7f306006df00 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.790+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30600aa670 con 0x7f306006df00 2024-08-17T02:49:53.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.791+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3060154c70 con 0x7f306006df00 2024-08-17T02:49:53.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.792+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f305001b400 con 0x7f306006df00 2024-08-17T02:49:53.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.793+0000 7f3056a00640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3040065150 0x7f3040067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:53.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.793+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3050082360 con 0x7f306006df00 2024-08-17T02:49:53.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.793+0000 7f305ea00640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3040065150 0x7f3040067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:53.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.794+0000 7f305ea00640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3040065150 0x7f3040067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f304c034000 tx=0x7f304c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:53.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.797+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3060154c70 con 0x7f306006df00 2024-08-17T02:49:53.971 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.970+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3060154c70 con 0x7f306006df00 2024-08-17T02:49:53.972 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.971+0000 7f3056a00640 1 -- 172.21.15.149:0/822967776 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f3060154c70 con 0x7f306006df00 2024-08-17T02:49:53.972 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":39,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:53.589060+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:53.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.973+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3040065150 msgr2=0x7f3040067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.973+0000 7f3066200640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3040065150 0x7f3040067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f304c034000 tx=0x7f304c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:53.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.973+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 msgr2=0x7f30600cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:53.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.973+0000 7f3066200640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600cb2d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f305000c5b0 tx=0x7f3050007d70 comp rx=0 tx=0).stop 2024-08-17T02:49:53.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 shutdown_connections 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3040065150 0x7f3040067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3060155df0 0x7f30600c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3060155a20 0x7f30600a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 --2- 172.21.15.149:0/822967776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f306006df00 0x7f30600cb2d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 >> 172.21.15.149:0/822967776 conn(0x7f30600cb9b0 msgr2=0x7f3060151890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 shutdown_connections 2024-08-17T02:49:53.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:53.974+0000 7f3066200640 1 -- 172.21.15.149:0/822967776 wait complete. 2024-08-17T02:49:53.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:47:35.786475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:47:36.882111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000066836.meta', 'create_time': '2024-08-17T02:47:48.713066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000066836'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000066836.data', 'create_time': '2024-08-17T02:47:49.612933+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000066836'}}}] 2024-08-17T02:49:53.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:49:54.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.141+0000 7ff7d1400640 1 Processor -- start 2024-08-17T02:49:54.142 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.141+0000 7ff7d1400640 1 -- start start 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.142+0000 7ff7d1400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff7cc06ddb0 0x7ff7cc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.142+0000 7ff7d1400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc0c83e0 con 0x7ff7cc155250 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.142+0000 7ff7d1400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc0cb7d0 con 0x7ff7cc06d9e0 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.142+0000 7ff7d1400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0aed90 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.143+0000 7ff7c9e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff7cc06ddb0 0x7ff7cc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.143+0000 7ff7cb200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff7cc155250 0x7ff7cc0acc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34342/0 (socket says 172.21.15.149:34342) 2024-08-17T02:49:54.143 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.143+0000 7ff7cb200640 1 -- 172.21.15.149:0/2540286144 learned_addr learned my addr 172.21.15.149:0/2540286144 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:54.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.143+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2540286144 >> v1:172.21.15.161:6789/0 conn(0x7ff7cc06d9e0 legacy=0x7ff7cc0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.143+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2540286144 >> v1:172.21.15.149:6789/0 conn(0x7ff7cc155250 legacy=0x7ff7cc0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.143+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2540286144 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0af070 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.144+0000 7ff7c9e00640 1 --2- 172.21.15.149:0/2540286144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc154d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009850 tx=0x7ff7b80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6431e164fcc38537 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.144+0000 7ff7c9400640 1 -- 172.21.15.149:0/2540286144 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b802ad00 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.144+0000 7ff7c9400640 1 -- 172.21.15.149:0/2540286144 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b802ae60 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.144+0000 7ff7c9400640 1 -- 172.21.15.149:0/2540286144 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8032670 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 -- 172.21.15.149:0/2540286144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 msgr2=0x7ff7cc154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2540286144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc154d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009850 tx=0x7ff7b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 -- 172.21.15.149:0/2540286144 shutdown_connections 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2540286144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc154d10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 -- 172.21.15.149:0/2540286144 >> 172.21.15.149:0/2540286144 conn(0x7ff7cc067750 msgr2=0x7ff7cc0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 -- 172.21.15.149:0/2540286144 shutdown_connections 2024-08-17T02:49:54.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.145+0000 7ff7d1400640 1 -- 172.21.15.149:0/2540286144 wait complete. 2024-08-17T02:49:54.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.146+0000 7ff7d1400640 1 Processor -- start 2024-08-17T02:49:54.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.147+0000 7ff7d1400640 1 -- start start 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.147+0000 7ff7d1400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7cc06d9e0 0x7ff7cc0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.147+0000 7ff7d1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7d1400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7cc155250 0x7ff7cc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7d1400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1507b0 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7d1400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c6330 con 0x7ff7cc155250 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7d1400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c6610 con 0x7ff7cc06d9e0 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc0cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39998/0 (socket says 172.21.15.149:39998) 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2180686587 learned_addr learned my addr 172.21.15.149:0/2180686587 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7ca800640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7cc06d9e0 0x7ff7cc0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7cb200640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7cc155250 0x7ff7cc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7cc06d9e0 msgr2=0x7ff7cc0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7cc06d9e0 0x7ff7cc0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7cc155250 msgr2=0x7ff7cc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7cc155250 0x7ff7cc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.148+0000 7ff7c9e00640 1 -- 172.21.15.149:0/2180686587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8009390 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.149+0000 7ff7c9e00640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc0cb960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009360 tx=0x7ff7b8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.149+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8032e20 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.149+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8031a60 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.149+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8031e20 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.149+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc0c68f0 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.149+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc169290 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.150+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc064db0 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.151+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff7b8043030 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.152+0000 7ff7c2000640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff7ac065150 0x7ff7ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.152+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff7b8041070 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.152+0000 7ff7ca800640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff7ac065150 0x7ff7ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.153+0000 7ff7ca800640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff7ac065150 0x7ff7ac067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc007fd0 tx=0x7ff7bc007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.156+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff7b8070c00 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.327+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7cc06e970 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.328+0000 7ff7c2000640 1 -- 172.21.15.149:0/2180686587 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7b804b0a0 con 0x7ff7cc06ddb0 2024-08-17T02:49:54.329 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:49:54.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff7ac065150 msgr2=0x7ff7ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff7ac065150 0x7ff7ac067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc007fd0 tx=0x7ff7bc007e30 comp rx=0 tx=0).stop 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 msgr2=0x7ff7cc0cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc0cb960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009360 tx=0x7ff7b8032000 comp rx=0 tx=0).stop 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 shutdown_connections 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff7ac065150 0x7ff7ac067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7cc155250 0x7ff7cc0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7cc06ddb0 0x7ff7cc0cb960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 --2- 172.21.15.149:0/2180686587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7cc06d9e0 0x7ff7cc0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 >> 172.21.15.149:0/2180686587 conn(0x7ff7cc067750 msgr2=0x7ff7cc153810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:54.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 shutdown_connections 2024-08-17T02:49:54.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.330+0000 7ff7d1400640 1 -- 172.21.15.149:0/2180686587 wait complete. 2024-08-17T02:49:54.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:49:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.496+0000 7ff9fe000640 1 Processor -- start 2024-08-17T02:49:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.496+0000 7ff9fe000640 1 -- start start 2024-08-17T02:49:54.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9fe000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f8155a80 0x7ff9f806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9fe000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9f80c92e0 0x7ff9f80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9fe000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f81598f0 con 0x7ff9f80c7db0 2024-08-17T02:49:54.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9fe000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f8159bd0 con 0x7ff9f80c92e0 2024-08-17T02:49:54.502 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9fe000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8159eb0 con 0x7ff9f8155a80 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9f7400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f8155a80 0x7ff9f806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9f7e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9f80c92e0 0x7ff9f80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9f7400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f8155a80 0x7ff9f806dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:59568/0 (socket says 172.21.15.149:59568) 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.498+0000 7ff9f7400640 1 -- 172.21.15.149:0/3428409620 learned_addr learned my addr 172.21.15.149:0/3428409620 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.499+0000 7ff9f7e00640 1 -- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f8155a80 msgr2=0x7ff9f806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.499+0000 7ff9f7e00640 1 --2- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f8155a80 0x7ff9f806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.503 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.499+0000 7ff9f7e00640 1 -- 172.21.15.149:0/3428409620 >> v1:172.21.15.161:6789/0 conn(0x7ff9f80c7db0 legacy=0x7ff9f80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.499+0000 7ff9f7e00640 1 -- 172.21.15.149:0/3428409620 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f815a190 con 0x7ff9f80c92e0 2024-08-17T02:49:54.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.500+0000 7ff9f7e00640 1 --2- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f80c92e0 0x7ff9f80aea40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009e60 tx=0x7ff9f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2953809b2cf32b7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.500+0000 7ff9f6a00640 1 -- 172.21.15.149:0/3428409620 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0007550 con 0x7ff9f80c92e0 2024-08-17T02:49:54.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.500+0000 7ff9f6a00640 1 -- 172.21.15.149:0/3428409620 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f002d050 con 0x7ff9f80c92e0 2024-08-17T02:49:54.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.500+0000 7ff9f6a00640 1 -- 172.21.15.149:0/3428409620 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0007900 con 0x7ff9f80c92e0 2024-08-17T02:49:54.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 -- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f80c92e0 msgr2=0x7ff9f80aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 --2- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f80c92e0 0x7ff9f80aea40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009e60 tx=0x7ff9f0009780 comp rx=0 tx=0).stop 2024-08-17T02:49:54.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 -- 172.21.15.149:0/3428409620 shutdown_connections 2024-08-17T02:49:54.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 --2- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f80c92e0 0x7ff9f80aea40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 --2- 172.21.15.149:0/3428409620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f8155a80 0x7ff9f806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 -- 172.21.15.149:0/3428409620 >> 172.21.15.149:0/3428409620 conn(0x7ff9f8067750 msgr2=0x7ff9f80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:54.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 -- 172.21.15.149:0/3428409620 shutdown_connections 2024-08-17T02:49:54.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.501+0000 7ff9fe000640 1 -- 172.21.15.149:0/3428409620 wait complete. 2024-08-17T02:49:54.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.502+0000 7ff9fe000640 1 Processor -- start 2024-08-17T02:49:54.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.502+0000 7ff9fe000640 1 -- start start 2024-08-17T02:49:54.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.503+0000 7ff9fe000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f80c7db0 0x7ff9f8147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.503+0000 7ff9fe000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 0x7ff9f806a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.503+0000 7ff9fe000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8155a80 0x7ff9f80aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.503+0000 7ff9fe000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8154f30 con 0x7ff9f80c92e0 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.503+0000 7ff9fe000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8154360 con 0x7ff9f8155a80 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.503+0000 7ff9fe000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8154600 con 0x7ff9f80c7db0 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 0x7ff9f806a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 0x7ff9f806a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40004/0 (socket says 172.21.15.149:40004) 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 -- 172.21.15.149:0/2057669285 learned_addr learned my addr 172.21.15.149:0/2057669285 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9f7e00640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8155a80 0x7ff9f80aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9f7400640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f80c7db0 0x7ff9f8147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 -- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f80c7db0 msgr2=0x7ff9f8147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f80c7db0 0x7ff9f8147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 -- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8155a80 msgr2=0x7ff9f80aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8155a80 0x7ff9f80aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 -- 172.21.15.149:0/2057669285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009a20 con 0x7ff9f80c92e0 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.504+0000 7ff9eea00640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 0x7ff9f806a0b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c560 tx=0x7ff9e0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.505+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0011590 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.505+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0011710 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.505+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0011ad0 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.505+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f81548e0 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.505+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8147790 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.506+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f81550e0 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.507+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9e001b3b0 con 0x7ff9f80c92e0 2024-08-17T02:49:54.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.507+0000 7ff9ef400640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff9d4065150 0x7ff9d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.508+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff9e0081d30 con 0x7ff9f80c92e0 2024-08-17T02:49:54.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.508+0000 7ff9f7400640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff9d4065150 0x7ff9d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.509+0000 7ff9f7400640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff9d4065150 0x7ff9d4067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009c80 tx=0x7ff9e80091d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.512+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9f81550e0 con 0x7ff9f80c92e0 2024-08-17T02:49:54.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.685+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9f8071050 con 0x7ff9f80c92e0 2024-08-17T02:49:54.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.686+0000 7ff9ef400640 1 -- 172.21.15.149:0/2057669285 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9e0017020 con 0x7ff9f80c92e0 2024-08-17T02:49:54.686 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff9d4065150 msgr2=0x7ff9d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff9d4065150 0x7ff9d4067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009c80 tx=0x7ff9e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 msgr2=0x7ff9f806a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 0x7ff9f806a0b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c560 tx=0x7ff9e0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 shutdown_connections 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff9d4065150 0x7ff9d4067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8155a80 0x7ff9f80aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f80c92e0 0x7ff9f806a0b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 --2- 172.21.15.149:0/2057669285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9f80c7db0 0x7ff9f8147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 >> 172.21.15.149:0/2057669285 conn(0x7ff9f8067750 msgr2=0x7ff9f81491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 shutdown_connections 2024-08-17T02:49:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.688+0000 7ff9fe000640 1 -- 172.21.15.149:0/2057669285 wait complete. 2024-08-17T02:49:54.703 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:49:54.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.855+0000 7faff1000640 1 Processor -- start 2024-08-17T02:49:54.856 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.856+0000 7faff1000640 1 -- start start 2024-08-17T02:49:54.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7faff1000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fafec06c480 0x7fafec0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7faff1000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7faff1000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec06c980 con 0x7fafec0ad780 2024-08-17T02:49:54.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7faff1000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec06cc60 con 0x7fafec06c480 2024-08-17T02:49:54.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7faff1000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec06cf40 con 0x7fafec0caed0 2024-08-17T02:49:54.858 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7fafeb400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fafec0ad780 0x7fafec06da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34352/0 (socket says 172.21.15.149:34352) 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7fafeb400640 1 -- 172.21.15.149:0/2286347008 learned_addr learned my addr 172.21.15.149:0/2286347008 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7fafe2a00640 1 --2- 172.21.15.149:0/2286347008 >> v2:172.21.15.161:3300/0 conn(0x7fafec06c480 0x7fafec0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.857+0000 7fafebe00640 1 --2- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.858+0000 7fafeaa00640 1 -- 172.21.15.149:0/2286347008 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970377345 0 0) 0x7fafec06c980 con 0x7fafec0ad780 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.858+0000 7fafeaa00640 1 -- 172.21.15.149:0/2286347008 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd00034e0 con 0x7fafec0ad780 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.858+0000 7fafe2a00640 1 -- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 msgr2=0x7fafec154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.858+0000 7fafe2a00640 1 --2- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.858+0000 7fafe2a00640 1 -- 172.21.15.149:0/2286347008 >> v1:172.21.15.149:6789/0 conn(0x7fafec0ad780 legacy=0x7fafec06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.858+0000 7fafe2a00640 1 -- 172.21.15.149:0/2286347008 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec06d220 con 0x7fafec06c480 2024-08-17T02:49:54.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.859+0000 7fafe2a00640 1 --2- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec0adb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009e60 tx=0x7fafd4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e20186b81e9c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.859+0000 7fafeaa00640 1 -- 172.21.15.149:0/2286347008 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4007550 con 0x7fafec06c480 2024-08-17T02:49:54.860 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.859+0000 7fafeaa00640 1 -- 172.21.15.149:0/2286347008 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd402d050 con 0x7fafec06c480 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.859+0000 7fafeaa00640 1 -- 172.21.15.149:0/2286347008 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4007920 con 0x7fafec06c480 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 -- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 msgr2=0x7fafec0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 --2- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec0adb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009e60 tx=0x7fafd4009780 comp rx=0 tx=0).stop 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 -- 172.21.15.149:0/2286347008 shutdown_connections 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 --2- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 --2- 172.21.15.149:0/2286347008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec0adb50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 -- 172.21.15.149:0/2286347008 >> 172.21.15.149:0/2286347008 conn(0x7fafec0b0d70 msgr2=0x7fafec0b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 -- 172.21.15.149:0/2286347008 shutdown_connections 2024-08-17T02:49:54.861 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.860+0000 7faff1000640 1 -- 172.21.15.149:0/2286347008 wait complete. 2024-08-17T02:49:54.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.861+0000 7faff1000640 1 Processor -- start 2024-08-17T02:49:54.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.861+0000 7faff1000640 1 -- start start 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.862+0000 7faff1000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.862+0000 7faff1000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 0x7fafec169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.862+0000 7faff1000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.862+0000 7faff1000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec152cb0 con 0x7fafec0ad780 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.862+0000 7faff1000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec152110 con 0x7fafec06c480 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.862+0000 7faff1000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec152380 con 0x7fafec0caed0 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 0x7fafec169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 0x7fafec169030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40018/0 (socket says 172.21.15.149:40018) 2024-08-17T02:49:54.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 -- 172.21.15.149:0/2257039045 learned_addr learned my addr 172.21.15.149:0/2257039045 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:54.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafebe00640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafeb400640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 -- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 msgr2=0x7fafec1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 -- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 msgr2=0x7fafec14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec14e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 -- 172.21.15.149:0/2257039045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4009a20 con 0x7fafec0ad780 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.863+0000 7fafe2a00640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 0x7fafec169030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009ec0 tx=0x7fafd4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.864+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4031860 con 0x7fafec0ad780 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.864+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd40319e0 con 0x7fafec0ad780 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.864+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4031da0 con 0x7fafec0ad780 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.864+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec152660 con 0x7fafec0ad780 2024-08-17T02:49:54.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.864+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec14e620 con 0x7fafec0ad780 2024-08-17T02:49:54.866 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.865+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec152e60 con 0x7fafec0ad780 2024-08-17T02:49:54.866 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.866+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fafd403c420 con 0x7fafec0ad780 2024-08-17T02:49:54.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.867+0000 7fafe3400640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc8065220 0x7fafc80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:54.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.867+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fafd40a3eb0 con 0x7fafec0ad780 2024-08-17T02:49:54.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.867+0000 7fafeb400640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc8065220 0x7fafc80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:54.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.867+0000 7fafeb400640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc8065220 0x7fafc80676d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafec0aaf20 tx=0x7fafdc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:54.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:54.871+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fafec152e60 con 0x7fafec0ad780 2024-08-17T02:49:55.042 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.041+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafec152e60 con 0x7fafec0ad780 2024-08-17T02:49:55.042 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.041+0000 7fafe3400640 1 -- 172.21.15.149:0/2257039045 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafec152e60 con 0x7fafec0ad780 2024-08-17T02:49:55.042 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2024-08-17T02:49:55.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.043+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc8065220 msgr2=0x7fafc80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.043+0000 7faff1000640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc8065220 0x7fafc80676d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafec0aaf20 tx=0x7fafdc009040 comp rx=0 tx=0).stop 2024-08-17T02:49:55.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.043+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 msgr2=0x7fafec169030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.043+0000 7faff1000640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 0x7fafec169030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009ec0 tx=0x7fafd4037000 comp rx=0 tx=0).stop 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 shutdown_connections 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc8065220 0x7fafc80676d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafec0caed0 0x7fafec1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafec0ad780 0x7fafec169030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 --2- 172.21.15.149:0/2257039045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafec06c480 0x7fafec14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 >> 172.21.15.149:0/2257039045 conn(0x7fafec0b0d70 msgr2=0x7fafec068670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 shutdown_connections 2024-08-17T02:49:55.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.044+0000 7faff1000640 1 -- 172.21.15.149:0/2257039045 wait complete. 2024-08-17T02:49:55.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000066836.meta pg_num 2024-08-17T02:49:55.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.210+0000 7fa056e00640 1 Processor -- start 2024-08-17T02:49:55.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.210+0000 7fa056e00640 1 -- start start 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.211+0000 7fa056e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa050158940 0x7fa05015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.211+0000 7fa056e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158d10 0x7fa050066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.211+0000 7fa056e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa050159160 0x7fa050067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.211+0000 7fa056e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05006e660 con 0x7fa050158940 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa056e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500a9b70 con 0x7fa050159160 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa056e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05006da50 con 0x7fa050158d10 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa050158940 0x7fa05015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa050158940 0x7fa05015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40028/0 (socket says 172.21.15.149:40028) 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 -- 172.21.15.149:0/400034948 learned_addr learned my addr 172.21.15.149:0/400034948 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:55.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055000640 1 --2- 172.21.15.149:0/400034948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158d10 0x7fa050066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa056400640 1 --2- 172.21.15.149:0/400034948 >> v2:172.21.15.161:3300/0 conn(0x7fa050159160 0x7fa050067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 -- 172.21.15.149:0/400034948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158d10 msgr2=0x7fa050066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 --2- 172.21.15.149:0/400034948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158d10 0x7fa050066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 -- 172.21.15.149:0/400034948 >> v2:172.21.15.161:3300/0 conn(0x7fa050159160 msgr2=0x7fa050067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 --2- 172.21.15.149:0/400034948 >> v2:172.21.15.161:3300/0 conn(0x7fa050159160 0x7fa050067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa055a00640 1 -- 172.21.15.149:0/400034948 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05006dd30 con 0x7fa050158940 2024-08-17T02:49:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.212+0000 7fa056400640 1 --2- 172.21.15.149:0/400034948 >> v2:172.21.15.161:3300/0 conn(0x7fa050159160 0x7fa050067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.213+0000 7fa055a00640 1 --2- 172.21.15.149:0/400034948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158940 0x7fa05015d140 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa0500aef60 tx=0x7fa0440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530b051c24ce29df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa04fe00640 1 -- 172.21.15.149:0/400034948 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04402ad40 con 0x7fa050158940 2024-08-17T02:49:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa04fe00640 1 -- 172.21.15.149:0/400034948 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044032440 con 0x7fa050158940 2024-08-17T02:49:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa04fe00640 1 -- 172.21.15.149:0/400034948 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04402aea0 con 0x7fa050158940 2024-08-17T02:49:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 -- 172.21.15.149:0/400034948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158940 msgr2=0x7fa05015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 --2- 172.21.15.149:0/400034948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158940 0x7fa05015d140 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa0500aef60 tx=0x7fa0440091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 -- 172.21.15.149:0/400034948 shutdown_connections 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 --2- 172.21.15.149:0/400034948 >> v2:172.21.15.161:3300/0 conn(0x7fa050159160 0x7fa050067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 --2- 172.21.15.149:0/400034948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158d10 0x7fa050066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 --2- 172.21.15.149:0/400034948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158940 0x7fa05015d140 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 -- 172.21.15.149:0/400034948 >> 172.21.15.149:0/400034948 conn(0x7fa050067de0 msgr2=0x7fa0500681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 -- 172.21.15.149:0/400034948 shutdown_connections 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.214+0000 7fa056e00640 1 -- 172.21.15.149:0/400034948 wait complete. 2024-08-17T02:49:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.216+0000 7fa056e00640 1 Processor -- start 2024-08-17T02:49:55.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.216+0000 7fa056e00640 1 -- start start 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158940 0x7fa05015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158d10 0x7fa050140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa050159160 0x7fa0501595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015a8b0 con 0x7fa050158d10 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa050153e10 con 0x7fa050159160 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa050159ca0 con 0x7fa050158940 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158d10 0x7fa050140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158940 0x7fa05015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa056400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa050159160 0x7fa0501595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158940 0x7fa05015dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:59620/0 (socket says 172.21.15.149:59620) 2024-08-17T02:49:55.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055a00640 1 -- 172.21.15.149:0/4235622586 learned_addr learned my addr 172.21.15.149:0/4235622586 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:55.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055000640 1 -- 172.21.15.149:0/4235622586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158940 msgr2=0x7fa05015dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055000640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158940 0x7fa05015dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055000640 1 -- 172.21.15.149:0/4235622586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa050159160 msgr2=0x7fa0501595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055000640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa050159160 0x7fa0501595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.217+0000 7fa055000640 1 -- 172.21.15.149:0/4235622586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009450 con 0x7fa050158d10 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.218+0000 7fa055000640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158d10 0x7fa050140540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00d8c0 tx=0x7fa03c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.218+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00b6c0 con 0x7fa050158d10 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.218+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00b820 con 0x7fa050158d10 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.218+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00bbc0 con 0x7fa050158d10 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.218+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa050159f80 con 0x7fa050158d10 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.218+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05015a540 con 0x7fa050158d10 2024-08-17T02:49:55.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.219+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05015aa60 con 0x7fa050158d10 2024-08-17T02:49:55.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.220+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa03c01e460 con 0x7fa050158d10 2024-08-17T02:49:55.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.221+0000 7fa04cc00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa030065150 0x7fa030067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.221+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa03c082c50 con 0x7fa050158d10 2024-08-17T02:49:55.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.221+0000 7fa055a00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa030065150 0x7fa030067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.222+0000 7fa055a00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa030065150 0x7fa030067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa0440093f0 tx=0x7fa044032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.226 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.225+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa05015aa60 con 0x7fa050158d10 2024-08-17T02:49:55.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.396+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.meta", "var": "pg_num"} v 0) v1 -- 0x7fa050071050 con 0x7fa050158d10 2024-08-17T02:49:55.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.397+0000 7fa04cc00640 1 -- 172.21.15.149:0/4235622586 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.meta", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7fa03c082020 con 0x7fa050158d10 2024-08-17T02:49:55.398 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa030065150 msgr2=0x7fa030067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa030065150 0x7fa030067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa0440093f0 tx=0x7fa044032000 comp rx=0 tx=0).stop 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158d10 msgr2=0x7fa050140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158d10 0x7fa050140540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00d8c0 tx=0x7fa03c008040 comp rx=0 tx=0).stop 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 shutdown_connections 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa030065150 0x7fa030067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa050159160 0x7fa0501595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa050158d10 0x7fa050140540 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 --2- 172.21.15.149:0/4235622586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa050158940 0x7fa05015dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 >> 172.21.15.149:0/4235622586 conn(0x7fa050067de0 msgr2=0x7fa050069610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 shutdown_connections 2024-08-17T02:49:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.399+0000 7fa056e00640 1 -- 172.21.15.149:0/4235622586 wait complete. 2024-08-17T02:49:55.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000066836.data pg_num 2024-08-17T02:49:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.565+0000 7fd723000640 1 Processor -- start 2024-08-17T02:49:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.565+0000 7fd723000640 1 -- start start 2024-08-17T02:49:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.566+0000 7fd723000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd71c159170 0x7fd71c0ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd723000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c0aaf20 0x7fd71c0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd723000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0681f0 con 0x7fd71c158da0 2024-08-17T02:49:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd723000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c0b08c0 con 0x7fd71c159170 2024-08-17T02:49:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd723000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0aca00 con 0x7fd71c0aaf20 2024-08-17T02:49:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd713400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd71c159170 0x7fd71c0ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd713400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd71c159170 0x7fd71c0ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:36464/0 (socket says 172.21.15.149:36464) 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd713400640 1 -- 172.21.15.149:0/1734927361 learned_addr learned my addr 172.21.15.149:0/1734927361 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.567+0000 7fd721000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c0aaf20 0x7fd71c0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.568+0000 7fd713400640 1 -- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c0aaf20 msgr2=0x7fd71c0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.568+0000 7fd713400640 1 --2- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c0aaf20 0x7fd71c0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.568+0000 7fd713400640 1 -- 172.21.15.149:0/1734927361 >> v1:172.21.15.161:6789/0 conn(0x7fd71c158da0 legacy=0x7fd71c0aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.568+0000 7fd713400640 1 -- 172.21.15.149:0/1734927361 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0acce0 con 0x7fd71c159170 2024-08-17T02:49:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.569+0000 7fd713400640 1 --2- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c159170 0x7fd71c0ac3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd704009910 tx=0x7fd7040091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d410a30dd042b610 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.569+0000 7fd71b400640 1 -- 172.21.15.149:0/1734927361 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70402adb0 con 0x7fd71c159170 2024-08-17T02:49:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.569+0000 7fd71b400640 1 -- 172.21.15.149:0/1734927361 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704032440 con 0x7fd71c159170 2024-08-17T02:49:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.569+0000 7fd71b400640 1 -- 172.21.15.149:0/1734927361 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704032820 con 0x7fd71c159170 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 -- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c159170 msgr2=0x7fd71c0ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 --2- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c159170 0x7fd71c0ac3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd704009910 tx=0x7fd7040091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 -- 172.21.15.149:0/1734927361 shutdown_connections 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 --2- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c0aaf20 0x7fd71c0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 --2- 172.21.15.149:0/1734927361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c159170 0x7fd71c0ac3e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 -- 172.21.15.149:0/1734927361 >> 172.21.15.149:0/1734927361 conn(0x7fd71c096a70 msgr2=0x7fd71c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 -- 172.21.15.149:0/1734927361 shutdown_connections 2024-08-17T02:49:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.570+0000 7fd723000640 1 -- 172.21.15.149:0/1734927361 wait complete. 2024-08-17T02:49:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.571+0000 7fd723000640 1 Processor -- start 2024-08-17T02:49:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 -- start start 2024-08-17T02:49:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c0aaf20 0x7fd71c0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c158da0 0x7fd71c097910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 0x7fd71c06b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c098fe0 con 0x7fd71c099470 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0983d0 con 0x7fd71c0aaf20 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.572+0000 7fd723000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0986b0 con 0x7fd71c158da0 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 0x7fd71c06b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 0x7fd71c06b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40040/0 (socket says 172.21.15.149:40040) 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 -- 172.21.15.149:0/605000226 learned_addr learned my addr 172.21.15.149:0/605000226 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd71be00640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c0aaf20 0x7fd71c0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd713400640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c158da0 0x7fd71c097910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 -- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c158da0 msgr2=0x7fd71c097910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c158da0 0x7fd71c097910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 -- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c0aaf20 msgr2=0x7fd71c0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c0aaf20 0x7fd71c0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 -- 172.21.15.149:0/605000226 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704009450 con 0x7fd71c099470 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.573+0000 7fd721000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 0x7fd71c06b540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd714009ef0 tx=0x7fd71400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.574+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71400ce10 con 0x7fd71c099470 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.574+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71400f040 con 0x7fd71c099470 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.574+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c098990 con 0x7fd71c099470 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.574+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140146d0 con 0x7fd71c099470 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.574+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c153e10 con 0x7fd71c099470 2024-08-17T02:49:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.575+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c099150 con 0x7fd71c099470 2024-08-17T02:49:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.576+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd714014a80 con 0x7fd71c099470 2024-08-17T02:49:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.577+0000 7fd713e00640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6f8065180 0x7fd6f8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.577+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd714083550 con 0x7fd71c099470 2024-08-17T02:49:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.577+0000 7fd71be00640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6f8065180 0x7fd6f8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.578+0000 7fd71be00640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6f8065180 0x7fd6f8067630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd70c007fd0 tx=0x7fd70c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.581+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd714051360 con 0x7fd71c099470 2024-08-17T02:49:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.754+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.data", "var": "pg_num"} v 0) v1 -- 0x7fd71c071050 con 0x7fd71c099470 2024-08-17T02:49:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.754+0000 7fd713e00640 1 -- 172.21.15.149:0/605000226 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.data", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7fd714054980 con 0x7fd71c099470 2024-08-17T02:49:55.755 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:49:55.757 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6f8065180 msgr2=0x7fd6f8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.757 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6f8065180 0x7fd6f8067630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd70c007fd0 tx=0x7fd70c007e30 comp rx=0 tx=0).stop 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 msgr2=0x7fd71c06b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 0x7fd71c06b540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd714009ef0 tx=0x7fd71400b040 comp rx=0 tx=0).stop 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 shutdown_connections 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fd6f8065180 0x7fd6f8067630 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71c099470 0x7fd71c06b540 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71c158da0 0x7fd71c097910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 --2- 172.21.15.149:0/605000226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71c0aaf20 0x7fd71c0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 >> 172.21.15.149:0/605000226 conn(0x7fd71c096a70 msgr2=0x7fd71c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 shutdown_connections 2024-08-17T02:49:55.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.757+0000 7fd723000640 1 -- 172.21.15.149:0/605000226 wait complete. 2024-08-17T02:49:55.772 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.921+0000 7fb050a00640 1 Processor -- start 2024-08-17T02:49:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.922+0000 7fb050a00640 1 -- start start 2024-08-17T02:49:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb050a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb04c0b0270 0x7fb04c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb050a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb050a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c157690 con 0x7fb04c155900 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb050a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c156a80 con 0x7fb04c158b30 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb050a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c156d60 con 0x7fb04c0b0270 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb04b200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb04b200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40054/0 (socket says 172.21.15.149:40054) 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb04b200640 1 -- 172.21.15.149:0/3654694030 learned_addr learned my addr 172.21.15.149:0/3654694030 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.923+0000 7fb041e00640 1 --2- 172.21.15.149:0/3654694030 >> v2:172.21.15.161:3300/0 conn(0x7fb04c0b0270 0x7fb04c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.924+0000 7fb04b200640 1 -- 172.21.15.149:0/3654694030 >> v2:172.21.15.161:3300/0 conn(0x7fb04c0b0270 msgr2=0x7fb04c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.924+0000 7fb04b200640 1 --2- 172.21.15.149:0/3654694030 >> v2:172.21.15.161:3300/0 conn(0x7fb04c0b0270 0x7fb04c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.924+0000 7fb04b200640 1 -- 172.21.15.149:0/3654694030 >> v1:172.21.15.161:6789/0 conn(0x7fb04c155900 legacy=0x7fb04c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.924+0000 7fb04b200640 1 -- 172.21.15.149:0/3654694030 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c157040 con 0x7fb04c158b30 2024-08-17T02:49:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.925+0000 7fb04b200640 1 --2- 172.21.15.149:0/3654694030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb04c06f430 tx=0x7fb044009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3579d308cc6fcda server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.925+0000 7fb049e00640 1 -- 172.21.15.149:0/3654694030 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04402e050 con 0x7fb04c158b30 2024-08-17T02:49:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.925+0000 7fb049e00640 1 -- 172.21.15.149:0/3654694030 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044007400 con 0x7fb04c158b30 2024-08-17T02:49:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.925+0000 7fb049e00640 1 -- 172.21.15.149:0/3654694030 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440077e0 con 0x7fb04c158b30 2024-08-17T02:49:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.925+0000 7fb050a00640 1 -- 172.21.15.149:0/3654694030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 msgr2=0x7fb04c0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.925+0000 7fb050a00640 1 --2- 172.21.15.149:0/3654694030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb04c06f430 tx=0x7fb044009840 comp rx=0 tx=0).stop 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.926+0000 7fb050a00640 1 -- 172.21.15.149:0/3654694030 shutdown_connections 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.926+0000 7fb050a00640 1 --2- 172.21.15.149:0/3654694030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.926+0000 7fb050a00640 1 --2- 172.21.15.149:0/3654694030 >> v2:172.21.15.161:3300/0 conn(0x7fb04c0b0270 0x7fb04c1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.926+0000 7fb050a00640 1 -- 172.21.15.149:0/3654694030 >> 172.21.15.149:0/3654694030 conn(0x7fb04c067750 msgr2=0x7fb04c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.926+0000 7fb050a00640 1 -- 172.21.15.149:0/3654694030 shutdown_connections 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.926+0000 7fb050a00640 1 -- 172.21.15.149:0/3654694030 wait complete. 2024-08-17T02:49:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.927+0000 7fb050a00640 1 Processor -- start 2024-08-17T02:49:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.927+0000 7fb050a00640 1 -- start start 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb050a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb04c0b0270 0x7fb04c145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb050a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb04c155900 0x7fb04c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb050a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb050a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c14ae20 con 0x7fb04c158b30 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb050a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c14a210 con 0x7fb04c155900 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb050a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c14a4f0 con 0x7fb04c0b0270 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb04b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb04b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40062/0 (socket says 172.21.15.149:40062) 2024-08-17T02:49:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb041e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb04c155900 0x7fb04c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb04b200640 1 -- 172.21.15.149:0/3765062996 learned_addr learned my addr 172.21.15.149:0/3765062996 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.928+0000 7fb04a800640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb04c0b0270 0x7fb04c145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.929+0000 7fb04b200640 1 -- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb04c0b0270 msgr2=0x7fb04c145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.929+0000 7fb04b200640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb04c0b0270 0x7fb04c145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.929+0000 7fb04b200640 1 -- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb04c155900 msgr2=0x7fb04c149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.929+0000 7fb04b200640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb04c155900 0x7fb04c149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.929+0000 7fb04b200640 1 -- 172.21.15.149:0/3765062996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044009ae0 con 0x7fb04c158b30 2024-08-17T02:49:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.929+0000 7fb04b200640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb04402ad60 tx=0x7fb044037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.932+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044007170 con 0x7fb04c158b30 2024-08-17T02:49:55.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.932+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044033e40 con 0x7fb04c158b30 2024-08-17T02:49:55.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.932+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04403c640 con 0x7fb04c158b30 2024-08-17T02:49:55.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.932+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c14a7d0 con 0x7fb04c158b30 2024-08-17T02:49:55.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.933+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c149eb0 con 0x7fb04c158b30 2024-08-17T02:49:55.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.934+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c14afd0 con 0x7fb04c158b30 2024-08-17T02:49:55.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.934+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb044039050 con 0x7fb04c158b30 2024-08-17T02:49:55.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.935+0000 7fb042a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb028065150 0x7fb028067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:55.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.936+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb0440a2de0 con 0x7fb04c158b30 2024-08-17T02:49:55.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.936+0000 7fb04a800640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb028065150 0x7fb028067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:55.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.936+0000 7fb04a800640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb028065150 0x7fb028067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007fd0 tx=0x7fb03c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:55.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:55.940+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb04c14afd0 con 0x7fb04c158b30 2024-08-17T02:49:56.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.148+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb04c14ac50 con 0x7fb04c158b30 2024-08-17T02:49:56.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.148+0000 7fb042a00640 1 -- 172.21.15.149:0/3765062996 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7fb044070bb0 con 0x7fb04c158b30 2024-08-17T02:49:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:56.149 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:37.896789+0000","modified":"2024-08-17T02:47:41.522751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4870":{"gid":4870,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/807513628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":807513628},{"type":"v1","addr":"172.21.15.161:6835","nonce":807513628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:56.149 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 21 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb028065150 msgr2=0x7fb028067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb028065150 0x7fb028067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007fd0 tx=0x7fb03c007e30 comp rx=0 tx=0).stop 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 msgr2=0x7fb04c0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb04402ad60 tx=0x7fb044037000 comp rx=0 tx=0).stop 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 shutdown_connections 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb028065150 0x7fb028067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb04c158b30 0x7fb04c0ae6b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb04c155900 0x7fb04c149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 --2- 172.21.15.149:0/3765062996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb04c0b0270 0x7fb04c145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 >> 172.21.15.149:0/3765062996 conn(0x7fb04c067750 msgr2=0x7fb04c14d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 shutdown_connections 2024-08-17T02:49:56.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.151+0000 7fb050a00640 1 -- 172.21.15.149:0/3765062996 wait complete. 2024-08-17T02:49:56.167 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:56.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.315+0000 7f145d600640 1 Processor -- start 2024-08-17T02:49:56.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.315+0000 7f145d600640 1 -- start start 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f145d600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458155df0 0x7f14580adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f145d600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1458156670 con 0x7f145806df00 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f145d600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145806e5e0 con 0x7f1458155a20 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f145d600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580b0350 con 0x7f1458155df0 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f144fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f145806df00 0x7f1458156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34358/0 (socket says 172.21.15.149:34358) 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f144fe00640 1 -- 172.21.15.149:0/8156346 learned_addr learned my addr 172.21.15.149:0/8156346 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f1457400640 1 --2- 172.21.15.149:0/8156346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458155df0 0x7f14580adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216542902 0 0) 0x7f1458156670 con 0x7f145806df00 2024-08-17T02:49:56.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f143c0034e0 con 0x7f145806df00 2024-08-17T02:49:56.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.317+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372504005 0 0) 0x7f145806e5e0 con 0x7f1458155a20 2024-08-17T02:49:56.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.318+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1458156670 con 0x7f1458155a20 2024-08-17T02:49:56.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.318+0000 7f1457400640 1 -- 172.21.15.149:0/8156346 >> v1:172.21.15.161:6789/0 conn(0x7f1458155a20 legacy=0x7f145806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.318+0000 7f1457400640 1 -- 172.21.15.149:0/8156346 >> v1:172.21.15.149:6789/0 conn(0x7f145806df00 legacy=0x7f1458156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.318+0000 7f1457400640 1 -- 172.21.15.149:0/8156346 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145806e8c0 con 0x7f1458155df0 2024-08-17T02:49:56.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.319+0000 7f1457400640 1 --2- 172.21.15.149:0/8156346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458155df0 0x7f14580adf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1450009e90 tx=0x7f1450009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a5fda26ac680c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:56.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.319+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450007550 con 0x7f1458155df0 2024-08-17T02:49:56.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.319+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145002d050 con 0x7f1458155df0 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.319+0000 7f1456000640 1 -- 172.21.15.149:0/8156346 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500078c0 con 0x7f1458155df0 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.319+0000 7f145d600640 1 -- 172.21.15.149:0/8156346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458155df0 msgr2=0x7f14580adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.319+0000 7f145d600640 1 --2- 172.21.15.149:0/8156346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458155df0 0x7f14580adf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1450009e90 tx=0x7f1450009780 comp rx=0 tx=0).stop 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.320+0000 7f145d600640 1 -- 172.21.15.149:0/8156346 shutdown_connections 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.320+0000 7f145d600640 1 --2- 172.21.15.149:0/8156346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458155df0 0x7f14580adf10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.320+0000 7f145d600640 1 -- 172.21.15.149:0/8156346 >> 172.21.15.149:0/8156346 conn(0x7f14580cb9b0 msgr2=0x7f14580cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.320+0000 7f145d600640 1 -- 172.21.15.149:0/8156346 shutdown_connections 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.320+0000 7f145d600640 1 -- 172.21.15.149:0/8156346 wait complete. 2024-08-17T02:49:56.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.321+0000 7f145d600640 1 Processor -- start 2024-08-17T02:49:56.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.321+0000 7f145d600640 1 -- start start 2024-08-17T02:49:56.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f145d600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145806df00 0x7f145813eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f145d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 0x7f145813f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f145d600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1458155df0 0x7f1458153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f145d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145813f050 con 0x7f1458155a20 2024-08-17T02:49:56.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f145d600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580aac00 con 0x7f1458155df0 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f145d600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580a9ff0 con 0x7f145806df00 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f144fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 0x7f145813f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f144fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 0x7f145813f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40068/0 (socket says 172.21.15.149:40068) 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f144fe00640 1 -- 172.21.15.149:0/3488361670 learned_addr learned my addr 172.21.15.149:0/3488361670 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f1457400640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1458155df0 0x7f1458153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.322+0000 7f1456a00640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145806df00 0x7f145813eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144fe00640 1 -- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145806df00 msgr2=0x7f145813eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144fe00640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145806df00 0x7f145813eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144fe00640 1 -- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1458155df0 msgr2=0x7f1458153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144fe00640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1458155df0 0x7f1458153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144fe00640 1 -- 172.21.15.149:0/3488361670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450009a20 con 0x7f1458155a20 2024-08-17T02:49:56.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144fe00640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 0x7f145813f2c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f144000c790 tx=0x7f1440007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:56.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000ce60 con 0x7f1458155a20 2024-08-17T02:49:56.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440005870 con 0x7f1458155a20 2024-08-17T02:49:56.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440005c30 con 0x7f1458155a20 2024-08-17T02:49:56.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14580aa2d0 con 0x7f1458155a20 2024-08-17T02:49:56.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.323+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14580aa890 con 0x7f1458155a20 2024-08-17T02:49:56.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.325+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14580aad90 con 0x7f1458155a20 2024-08-17T02:49:56.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.325+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1440007300 con 0x7f1458155a20 2024-08-17T02:49:56.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.326+0000 7f144e000640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1434065150 0x7f1434067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.326+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f14400820d0 con 0x7f1458155a20 2024-08-17T02:49:56.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.326+0000 7f1456a00640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1434065150 0x7f1434067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.327+0000 7f1456a00640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1434065150 0x7f1434067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1448003a10 tx=0x7f1448007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:56.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.330+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14400539d0 con 0x7f1458155a20 2024-08-17T02:49:56.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.503+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1458064db0 con 0x7f1458155a20 2024-08-17T02:49:56.504 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.504+0000 7f144e000640 1 -- 172.21.15.149:0/3488361670 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f144000b0d0 con 0x7f1458155a20 2024-08-17T02:49:56.505 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:56.505 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":39,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:53.589060+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:56.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1434065150 msgr2=0x7f1434067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1434065150 0x7f1434067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1448003a10 tx=0x7f1448007cc0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 msgr2=0x7f145813f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 0x7f145813f2c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f144000c790 tx=0x7f1440007db0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 shutdown_connections 2024-08-17T02:49:56.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1434065150 0x7f1434067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.506+0000 7f145d600640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1458155df0 0x7f1458153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.507+0000 7f145d600640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1458155a20 0x7f145813f2c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.507+0000 7f145d600640 1 --2- 172.21.15.149:0/3488361670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145806df00 0x7f145813eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.507+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 >> 172.21.15.149:0/3488361670 conn(0x7f14580cb9b0 msgr2=0x7f14580add20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.507+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 shutdown_connections 2024-08-17T02:49:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.507+0000 7f145d600640 1 -- 172.21.15.149:0/3488361670 wait complete. 2024-08-17T02:49:56.523 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:49:56.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:56.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.672+0000 7f8649200640 1 Processor -- start 2024-08-17T02:49:56.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.672+0000 7f8649200640 1 -- start start 2024-08-17T02:49:56.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.673+0000 7f8649200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8644155a20 0x7f86440adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.673+0000 7f8649200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8644155df0 0x7f86440ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8649200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8644156670 con 0x7f864406d7f0 2024-08-17T02:49:56.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8649200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86440b0350 con 0x7f8644155a20 2024-08-17T02:49:56.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8649200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864406e5e0 con 0x7f8644155df0 2024-08-17T02:49:56.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8644155a20 0x7f86440adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8644155a20 0x7f86440adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40070/0 (socket says 172.21.15.149:40070) 2024-08-17T02:49:56.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 -- 172.21.15.149:0/1876602160 learned_addr learned my addr 172.21.15.149:0/1876602160 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:56.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 -- 172.21.15.149:0/1876602160 >> v2:172.21.15.161:3300/0 conn(0x7f8644155df0 msgr2=0x7f86440ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:56.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 --2- 172.21.15.149:0/1876602160 >> v2:172.21.15.161:3300/0 conn(0x7f8644155df0 0x7f86440ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 -- 172.21.15.149:0/1876602160 >> v1:172.21.15.149:6789/0 conn(0x7f864406d7f0 legacy=0x7f86440ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:56.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.674+0000 7f8641e00640 1 -- 172.21.15.149:0/1876602160 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864406e8c0 con 0x7f8644155a20 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.675+0000 7f8641e00640 1 --2- 172.21.15.149:0/1876602160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155a20 0x7f86440adf10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f864406aa10 tx=0x7f86340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680dcefa24e9753e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8641400640 1 -- 172.21.15.149:0/1876602160 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863402ae60 con 0x7f8644155a20 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8641400640 1 -- 172.21.15.149:0/1876602160 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634032440 con 0x7f8644155a20 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8641400640 1 -- 172.21.15.149:0/1876602160 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340327e0 con 0x7f8644155a20 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 -- 172.21.15.149:0/1876602160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155a20 msgr2=0x7f86440adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 --2- 172.21.15.149:0/1876602160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155a20 0x7f86440adf10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f864406aa10 tx=0x7f86340091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 -- 172.21.15.149:0/1876602160 shutdown_connections 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 --2- 172.21.15.149:0/1876602160 >> v2:172.21.15.161:3300/0 conn(0x7f8644155df0 0x7f86440ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 --2- 172.21.15.149:0/1876602160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155a20 0x7f86440adf10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 -- 172.21.15.149:0/1876602160 >> 172.21.15.149:0/1876602160 conn(0x7f86440cb9b0 msgr2=0x7f86440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:56.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 -- 172.21.15.149:0/1876602160 shutdown_connections 2024-08-17T02:49:56.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.676+0000 7f8649200640 1 -- 172.21.15.149:0/1876602160 wait complete. 2024-08-17T02:49:56.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.678+0000 7f8649200640 1 Processor -- start 2024-08-17T02:49:56.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.678+0000 7f8649200640 1 -- start start 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8649200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f864406d7f0 0x7f8644143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8649200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8644155a20 0x7f8644157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8649200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 0x7f86440ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8649200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644147c00 con 0x7f8644155df0 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8649200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440aba80 con 0x7f8644155a20 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8649200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441584e0 con 0x7f864406d7f0 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 0x7f86440ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 0x7f86440ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40086/0 (socket says 172.21.15.149:40086) 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 -- 172.21.15.149:0/392220879 learned_addr learned my addr 172.21.15.149:0/392220879 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:56.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8641e00640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f864406d7f0 0x7f8644143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8639400640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8644155a20 0x7f8644157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 -- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f864406d7f0 msgr2=0x7f8644143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f864406d7f0 0x7f8644143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 -- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8644155a20 msgr2=0x7f8644157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8644155a20 0x7f8644157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.679+0000 7f8642800640 1 -- 172.21.15.149:0/392220879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009450 con 0x7f8644155df0 2024-08-17T02:49:56.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.680+0000 7f8642800640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 0x7f86440ad2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c860 tx=0x7f863c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:56.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.680+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00ce50 con 0x7f8644155df0 2024-08-17T02:49:56.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.680+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00a850 con 0x7f8644155df0 2024-08-17T02:49:56.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.680+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00ac10 con 0x7f8644155df0 2024-08-17T02:49:56.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.680+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440aae70 con 0x7f8644155df0 2024-08-17T02:49:56.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.680+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86440ab430 con 0x7f8644155df0 2024-08-17T02:49:56.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.681+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86440abc10 con 0x7f8644155df0 2024-08-17T02:49:56.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.682+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f863c012630 con 0x7f8644155df0 2024-08-17T02:49:56.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.683+0000 7f863a000640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8620065150 0x7f8620067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:56.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.683+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f863c082970 con 0x7f8644155df0 2024-08-17T02:49:56.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.683+0000 7f8641e00640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8620065150 0x7f8620067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:56.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.684+0000 7f8641e00640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8620065150 0x7f8620067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8634034000 tx=0x7f8634032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:56.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.687+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f863c050760 con 0x7f8644155df0 2024-08-17T02:49:56.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.892+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8644064db0 con 0x7f8644155df0 2024-08-17T02:49:56.893 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.892+0000 7f863a000640 1 -- 172.21.15.149:0/392220879 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f863c053d80 con 0x7f8644155df0 2024-08-17T02:49:56.893 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:56.893 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:37.896789+0000","modified":"2024-08-17T02:47:41.522751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4870":{"gid":4870,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/807513628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":807513628},{"type":"v1","addr":"172.21.15.161:6835","nonce":807513628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:56.893 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 21 2024-08-17T02:49:56.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.894+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8620065150 msgr2=0x7f8620067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.894+0000 7f8649200640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8620065150 0x7f8620067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8634034000 tx=0x7f8634032000 comp rx=0 tx=0).stop 2024-08-17T02:49:56.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.894+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 msgr2=0x7f86440ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:56.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.894+0000 7f8649200640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 0x7f86440ad2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c860 tx=0x7f863c001690 comp rx=0 tx=0).stop 2024-08-17T02:49:56.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 shutdown_connections 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8620065150 0x7f8620067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8644155df0 0x7f86440ad2a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8644155a20 0x7f8644157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 --2- 172.21.15.149:0/392220879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f864406d7f0 0x7f8644143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 >> 172.21.15.149:0/392220879 conn(0x7f86440cb9b0 msgr2=0x7f864406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 shutdown_connections 2024-08-17T02:49:56.896 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:56.895+0000 7f8649200640 1 -- 172.21.15.149:0/392220879 wait complete. 2024-08-17T02:49:56.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.061+0000 7f7edda00640 1 Processor -- start 2024-08-17T02:49:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.062+0000 7f7edda00640 1 -- start start 2024-08-17T02:49:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edda00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed80cbea0 0x7f7ed8156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edda00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 0x7f7ed81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edda00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed80cc2d0 con 0x7f7ed8156ad0 2024-08-17T02:49:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edda00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80ca900 con 0x7f7ed806dc80 2024-08-17T02:49:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edda00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80cc560 con 0x7f7ed80cbea0 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edd000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 0x7f7ed81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7ecf400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed80cbea0 0x7f7ed8156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edd000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 0x7f7ed81577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:33718/0 (socket says 172.21.15.149:33718) 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.063+0000 7f7edd000640 1 -- 172.21.15.149:0/2639093755 learned_addr learned my addr 172.21.15.149:0/2639093755 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.064+0000 7f7ecf400640 1 -- 172.21.15.149:0/2639093755 >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 msgr2=0x7f7ed81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.064+0000 7f7ecf400640 1 --2- 172.21.15.149:0/2639093755 >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 0x7f7ed81577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.064+0000 7f7ecf400640 1 -- 172.21.15.149:0/2639093755 >> v1:172.21.15.161:6789/0 conn(0x7f7ed8156ad0 legacy=0x7f7ed806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.064+0000 7f7ed7400640 1 -- 172.21.15.149:0/2639093755 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994924087 0 0) 0x7f7ed80cc2d0 con 0x7f7ed8156ad0 2024-08-17T02:49:57.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.064+0000 7f7ecf400640 1 -- 172.21.15.149:0/2639093755 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80caaf0 con 0x7f7ed80cbea0 2024-08-17T02:49:57.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.064+0000 7f7edd000640 1 --2- 172.21.15.149:0/2639093755 >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 0x7f7ed81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.065+0000 7f7ecf400640 1 --2- 172.21.15.149:0/2639093755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed80cbea0 0x7f7ed8156ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009850 tx=0x7f7ec00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e502195a45a8ca4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.065+0000 7f7ed7400640 1 -- 172.21.15.149:0/2639093755 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec002ad90 con 0x7f7ed80cbea0 2024-08-17T02:49:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.065+0000 7f7ed7400640 1 -- 172.21.15.149:0/2639093755 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0032440 con 0x7f7ed80cbea0 2024-08-17T02:49:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.065+0000 7f7ed7400640 1 -- 172.21.15.149:0/2639093755 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00327e0 con 0x7f7ed80cbea0 2024-08-17T02:49:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 -- 172.21.15.149:0/2639093755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed80cbea0 msgr2=0x7f7ed8156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 --2- 172.21.15.149:0/2639093755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed80cbea0 0x7f7ed8156ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009850 tx=0x7f7ec00090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 -- 172.21.15.149:0/2639093755 shutdown_connections 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 --2- 172.21.15.149:0/2639093755 >> v2:172.21.15.161:3300/0 conn(0x7f7ed806dc80 0x7f7ed81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 --2- 172.21.15.149:0/2639093755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed80cbea0 0x7f7ed8156ea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 -- 172.21.15.149:0/2639093755 >> 172.21.15.149:0/2639093755 conn(0x7f7ed8067750 msgr2=0x7f7ed80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 -- 172.21.15.149:0/2639093755 shutdown_connections 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.066+0000 7f7edda00640 1 -- 172.21.15.149:0/2639093755 wait complete. 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.067+0000 7f7edda00640 1 Processor -- start 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 -- start start 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 0x7f7ed80c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ed80cbea0 0x7f7ed8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed8156ad0 0x7f7ed8169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80c5370 con 0x7f7ed806dc80 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81514e0 con 0x7f7ed80cbea0 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.068+0000 7f7edda00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed816a480 con 0x7f7ed8156ad0 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 0x7f7ed80c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7edd000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed8156ad0 0x7f7ed8169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 0x7f7ed80c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55738/0 (socket says 172.21.15.149:55738) 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ecf400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ed80cbea0 0x7f7ed8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 -- 172.21.15.149:0/3732362105 learned_addr learned my addr 172.21.15.149:0/3732362105 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 -- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed8156ad0 msgr2=0x7f7ed8169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed8156ad0 0x7f7ed8169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 -- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ed80cbea0 msgr2=0x7f7ed8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ed80cbea0 0x7f7ed8150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ed7e00640 1 -- 172.21.15.149:0/3732362105 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0009450 con 0x7f7ed806dc80 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.069+0000 7f7ecf400640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ed80cbea0 0x7f7ed8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.070+0000 7f7ed7e00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 0x7f7ed80c7910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c880 tx=0x7f7ec8001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.070+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800ce70 con 0x7f7ed806dc80 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.070+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec800a850 con 0x7f7ed806dc80 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.070+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800ac30 con 0x7f7ed806dc80 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.070+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec0009390 con 0x7f7ed806dc80 2024-08-17T02:49:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.070+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8158ae0 con 0x7f7ed806dc80 2024-08-17T02:49:57.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.071+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8071050 con 0x7f7ed806dc80 2024-08-17T02:49:57.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.072+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7ec8003030 con 0x7f7ed806dc80 2024-08-17T02:49:57.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.073+0000 7f7ecfe00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7eb4065150 0x7f7eb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.073+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7ec80826b0 con 0x7f7ed806dc80 2024-08-17T02:49:57.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.073+0000 7f7ecf400640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7eb4065150 0x7f7eb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.074+0000 7f7ecf400640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7eb4065150 0x7f7eb4067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009850 tx=0x7f7ec0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.077+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7ec80504a0 con 0x7f7ed806dc80 2024-08-17T02:49:57.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.286+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ed80b0b10 con 0x7f7ed806dc80 2024-08-17T02:49:57.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.287+0000 7f7ecfe00640 1 -- 172.21.15.149:0/3732362105 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f7ec8053ac0 con 0x7f7ed806dc80 2024-08-17T02:49:57.287 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:57.287 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:37.896789+0000","modified":"2024-08-17T02:47:41.522751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4870":{"gid":4870,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/807513628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":807513628},{"type":"v1","addr":"172.21.15.161:6835","nonce":807513628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:57.288 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 21 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7eb4065150 msgr2=0x7f7eb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7eb4065150 0x7f7eb4067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009850 tx=0x7f7ec0032000 comp rx=0 tx=0).stop 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 msgr2=0x7f7ed80c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 0x7f7ed80c7910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c880 tx=0x7f7ec8001660 comp rx=0 tx=0).stop 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 shutdown_connections 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f7eb4065150 0x7f7eb4067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ed8156ad0 0x7f7ed8169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ed80cbea0 0x7f7ed8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 --2- 172.21.15.149:0/3732362105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed806dc80 0x7f7ed80c7910 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 >> 172.21.15.149:0/3732362105 conn(0x7f7ed8067750 msgr2=0x7f7ed806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:57.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 shutdown_connections 2024-08-17T02:49:57.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.289+0000 7f7edda00640 1 -- 172.21.15.149:0/3732362105 wait complete. 2024-08-17T02:49:57.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.453+0000 7f9737e00640 1 Processor -- start 2024-08-17T02:49:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.453+0000 7f9737e00640 1 -- start start 2024-08-17T02:49:57.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.454+0000 7f9737e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9730155550 0x7f97300aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.454+0000 7f9737e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f973006e080 0x7f973006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.454+0000 7f9737e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300afc10 con 0x7f9730155180 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.454+0000 7f9737e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973006ea00 con 0x7f973006e080 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.454+0000 7f9737e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300af000 con 0x7f9730155550 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f973006e080 0x7f973006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9730155180 0x7f97300ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54538/0 (socket says 172.21.15.149:54538) 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735400640 1 -- 172.21.15.149:0/85629339 learned_addr learned my addr 172.21.15.149:0/85629339 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9734a00640 1 --2- 172.21.15.149:0/85629339 >> v2:172.21.15.161:3300/0 conn(0x7f9730155550 0x7f97300aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735e00640 1 -- 172.21.15.149:0/85629339 >> v2:172.21.15.161:3300/0 conn(0x7f9730155550 msgr2=0x7f97300aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735e00640 1 --2- 172.21.15.149:0/85629339 >> v2:172.21.15.161:3300/0 conn(0x7f9730155550 0x7f97300aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735e00640 1 -- 172.21.15.149:0/85629339 >> v1:172.21.15.149:6789/0 conn(0x7f9730155180 legacy=0x7f97300ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9735e00640 1 -- 172.21.15.149:0/85629339 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300af2e0 con 0x7f973006e080 2024-08-17T02:49:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f9734a00640 1 --2- 172.21.15.149:0/85629339 >> v2:172.21.15.161:3300/0 conn(0x7f9730155550 0x7f97300aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.455+0000 7f972fe00640 1 -- 172.21.15.149:0/85629339 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072086020 0 0) 0x7f97300afc10 con 0x7f9730155180 2024-08-17T02:49:57.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.456+0000 7f9735e00640 1 --2- 172.21.15.149:0/85629339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f973006e4c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f973006c770 tx=0x7f9728009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609e4f92f0aa48a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.456+0000 7f972fe00640 1 -- 172.21.15.149:0/85629339 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728007550 con 0x7f973006e080 2024-08-17T02:49:57.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.456+0000 7f972fe00640 1 -- 172.21.15.149:0/85629339 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972802d050 con 0x7f973006e080 2024-08-17T02:49:57.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.456+0000 7f972fe00640 1 -- 172.21.15.149:0/85629339 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280078e0 con 0x7f973006e080 2024-08-17T02:49:57.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 -- 172.21.15.149:0/85629339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 msgr2=0x7f973006e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 --2- 172.21.15.149:0/85629339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f973006e4c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f973006c770 tx=0x7f9728009780 comp rx=0 tx=0).stop 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 -- 172.21.15.149:0/85629339 shutdown_connections 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 --2- 172.21.15.149:0/85629339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f973006e4c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 --2- 172.21.15.149:0/85629339 >> v2:172.21.15.161:3300/0 conn(0x7f9730155550 0x7f97300aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 -- 172.21.15.149:0/85629339 >> 172.21.15.149:0/85629339 conn(0x7f97300cb9b0 msgr2=0x7f97300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 -- 172.21.15.149:0/85629339 shutdown_connections 2024-08-17T02:49:57.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.457+0000 7f9737e00640 1 -- 172.21.15.149:0/85629339 wait complete. 2024-08-17T02:49:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.458+0000 7f9737e00640 1 Processor -- start 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 -- start start 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f97301559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9730155180 0x7f9730151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9730155550 0x7f97300c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730156dc0 con 0x7f973006e080 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730155f10 con 0x7f9730155550 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.459+0000 7f9737e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9730151dd0 con 0x7f9730155180 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f97301559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f97301559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55758/0 (socket says 172.21.15.149:55758) 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 -- 172.21.15.149:0/1564204555 learned_addr learned my addr 172.21.15.149:0/1564204555 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9734a00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9730155180 0x7f9730151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9730155550 0x7f97300c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 -- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9730155180 msgr2=0x7f9730151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9730155180 0x7f9730151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 -- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9730155550 msgr2=0x7f97300c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9730155550 0x7f97300c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 -- 172.21.15.149:0/1564204555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009a20 con 0x7f973006e080 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9734a00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9730155180 0x7f9730151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.460+0000 7f9735400640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f97301559d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f972400c5e0 tx=0x7f9724007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.461+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724005aa0 con 0x7f973006e080 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.461+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724005c00 con 0x7f973006e080 2024-08-17T02:49:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.461+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240070f0 con 0x7f973006e080 2024-08-17T02:49:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.461+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97301561b0 con 0x7f973006e080 2024-08-17T02:49:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.461+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9730156770 con 0x7f973006e080 2024-08-17T02:49:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.462+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9730064db0 con 0x7f973006e080 2024-08-17T02:49:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.463+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9724007520 con 0x7f973006e080 2024-08-17T02:49:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.463+0000 7f972cc00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9710065150 0x7f9710067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.464+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9724082290 con 0x7f973006e080 2024-08-17T02:49:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.464+0000 7f9734a00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9710065150 0x7f9710067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.464+0000 7f9734a00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9710065150 0x7f9710067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f971c006fd0 tx=0x7f971c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.467+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9724050050 con 0x7f973006e080 2024-08-17T02:49:57.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.641+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97300ae330 con 0x7f973006e080 2024-08-17T02:49:57.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.641+0000 7f972cc00640 1 -- 172.21.15.149:0/1564204555 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f9724053670 con 0x7f973006e080 2024-08-17T02:49:57.642 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:49:57.642 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":39,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:47:53.589060+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:35.786475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:36.882111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9710065150 msgr2=0x7f9710067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9710065150 0x7f9710067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f971c006fd0 tx=0x7f971c008040 comp rx=0 tx=0).stop 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 msgr2=0x7f97301559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f97301559d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f972400c5e0 tx=0x7f9724007d60 comp rx=0 tx=0).stop 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 shutdown_connections 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9710065150 0x7f9710067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9730155550 0x7f97300c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9730155180 0x7f9730151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 --2- 172.21.15.149:0/1564204555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973006e080 0x7f97301559d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 >> 172.21.15.149:0/1564204555 conn(0x7f97300cb9b0 msgr2=0x7f97300b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 shutdown_connections 2024-08-17T02:49:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.644+0000 7f9737e00640 1 -- 172.21.15.149:0/1564204555 wait complete. 2024-08-17T02:49:57.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:49:57.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.810+0000 7f8fc6a00640 1 Processor -- start 2024-08-17T02:49:57.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.810+0000 7f8fc6a00640 1 -- start start 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.811+0000 7f8fc6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fc00ceb40 0x7f8fc00cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.811+0000 7f8fc6a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8fc00ccad0 0x7f8fc0162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.811+0000 7f8fc6a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00ccf30 con 0x7f8fc0159ca0 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.811+0000 7f8fc6a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00cd6e0 con 0x7f8fc00ceb40 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.811+0000 7f8fc6a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00cadc0 con 0x7f8fc00ccad0 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc5600640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8fc0159ca0 0x7f8fc00ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54540/0 (socket says 172.21.15.149:54540) 2024-08-17T02:49:57.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc5600640 1 -- 172.21.15.149:0/2704136228 learned_addr learned my addr 172.21.15.149:0/2704136228 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:57.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc4c00640 1 --2- 172.21.15.149:0/2704136228 >> v2:172.21.15.149:3300/0 conn(0x7f8fc00ceb40 0x7f8fc00cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc6000640 1 --2- 172.21.15.149:0/2704136228 >> v2:172.21.15.161:3300/0 conn(0x7f8fc00ccad0 0x7f8fc0162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fbfe00640 1 -- 172.21.15.149:0/2704136228 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059447646 0 0) 0x7f8fc00ccf30 con 0x7f8fc0159ca0 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc4c00640 1 -- 172.21.15.149:0/2704136228 >> v2:172.21.15.161:3300/0 conn(0x7f8fc00ccad0 msgr2=0x7f8fc0162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc4c00640 1 --2- 172.21.15.149:0/2704136228 >> v2:172.21.15.161:3300/0 conn(0x7f8fc00ccad0 0x7f8fc0162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc4c00640 1 -- 172.21.15.149:0/2704136228 >> v1:172.21.15.149:6789/0 conn(0x7f8fc0159ca0 legacy=0x7f8fc00ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.812+0000 7f8fc4c00640 1 -- 172.21.15.149:0/2704136228 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00cb060 con 0x7f8fc00ceb40 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.813+0000 7f8fc4c00640 1 --2- 172.21.15.149:0/2704136228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ceb40 0x7f8fc00cc590 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00b26e0 tx=0x7f8fac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ac6f2918bce04a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.813+0000 7f8fbfe00640 1 -- 172.21.15.149:0/2704136228 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac02adb0 con 0x7f8fc00ceb40 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.813+0000 7f8fbfe00640 1 -- 172.21.15.149:0/2704136228 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac032440 con 0x7f8fc00ceb40 2024-08-17T02:49:57.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.813+0000 7f8fbfe00640 1 -- 172.21.15.149:0/2704136228 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0327e0 con 0x7f8fc00ceb40 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 -- 172.21.15.149:0/2704136228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ceb40 msgr2=0x7f8fc00cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/2704136228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ceb40 0x7f8fc00cc590 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00b26e0 tx=0x7f8fac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 -- 172.21.15.149:0/2704136228 shutdown_connections 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/2704136228 >> v2:172.21.15.161:3300/0 conn(0x7f8fc00ccad0 0x7f8fc0162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/2704136228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ceb40 0x7f8fc00cc590 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 -- 172.21.15.149:0/2704136228 >> 172.21.15.149:0/2704136228 conn(0x7f8fc0098e00 msgr2=0x7f8fc006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 -- 172.21.15.149:0/2704136228 shutdown_connections 2024-08-17T02:49:57.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.814+0000 7f8fc6a00640 1 -- 172.21.15.149:0/2704136228 wait complete. 2024-08-17T02:49:57.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.815+0000 7f8fc6a00640 1 Processor -- start 2024-08-17T02:49:57.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 -- start start 2024-08-17T02:49:57.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc00ccad0 0x7f8fc009c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc00ceb40 0x7f8fc0168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 0x7f8fc0168eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009b4f0 con 0x7f8fc0159ca0 2024-08-17T02:49:57.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009a970 con 0x7f8fc00ceb40 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.816+0000 7f8fc6a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009ac50 con 0x7f8fc00ccad0 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 0x7f8fc0168eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 0x7f8fc0168eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55780/0 (socket says 172.21.15.149:55780) 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 -- 172.21.15.149:0/3281278951 learned_addr learned my addr 172.21.15.149:0/3281278951 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc4c00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc00ceb40 0x7f8fc0168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc5600640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc00ccad0 0x7f8fc009c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 -- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc00ccad0 msgr2=0x7f8fc009c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc00ccad0 0x7f8fc009c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 -- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc00ceb40 msgr2=0x7f8fc0168970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc00ceb40 0x7f8fc0168970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 -- 172.21.15.149:0/3281278951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac009390 con 0x7f8fc0159ca0 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.817+0000 7f8fc6000640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 0x7f8fc0168eb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009fa0 tx=0x7f8fb8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.818+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800ee60 con 0x7f8fc0159ca0 2024-08-17T02:49:57.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.818+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8014420 con 0x7f8fc0159ca0 2024-08-17T02:49:57.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.818+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80147e0 con 0x7f8fc0159ca0 2024-08-17T02:49:57.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.818+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc009af30 con 0x7f8fc0159ca0 2024-08-17T02:49:57.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.818+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc009ce20 con 0x7f8fc0159ca0 2024-08-17T02:49:57.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.819+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc00c45c0 con 0x7f8fc0159ca0 2024-08-17T02:49:57.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.820+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8fb8014b50 con 0x7f8fc0159ca0 2024-08-17T02:49:57.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.820+0000 7f8fbcc00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8fa0065150 0x7f8fa0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:57.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.821+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8fb8082ec0 con 0x7f8fc0159ca0 2024-08-17T02:49:57.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.821+0000 7f8fc5600640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8fa0065150 0x7f8fa0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:57.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.821+0000 7f8fc5600640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8fa0065150 0x7f8fa0067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00c7510 tx=0x7f8fb4007ec0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:57.825+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8fc00c45c0 con 0x7f8fc0159ca0 2024-08-17T02:49:58.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.034+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8fc00c45c0 con 0x7f8fc0159ca0 2024-08-17T02:49:58.035 INFO:tasks.ceph.mon.a.smithi149.stderr:2024-08-17T02:49:58.035+0000 7fa0b9600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:49:58.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.040+0000 7f8fbcc00640 1 -- 172.21.15.149:0/3281278951 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8fc00c45c0 con 0x7f8fc0159ca0 2024-08-17T02:49:58.040 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:49:58.043 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8fa0065150 msgr2=0x7f8fa0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8fa0065150 0x7f8fa0067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00c7510 tx=0x7f8fb4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 msgr2=0x7f8fc0168eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 0x7f8fc0168eb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009fa0 tx=0x7f8fb8009900 comp rx=0 tx=0).stop 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 shutdown_connections 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8fa0065150 0x7f8fa0067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0159ca0 0x7f8fc0168eb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc00ceb40 0x7f8fc0168970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 --2- 172.21.15.149:0/3281278951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc00ccad0 0x7f8fc009c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 >> 172.21.15.149:0/3281278951 conn(0x7f8fc0098e00 msgr2=0x7f8fc006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 shutdown_connections 2024-08-17T02:49:58.044 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.043+0000 7f8fc6a00640 1 -- 172.21.15.149:0/3281278951 wait complete. 2024-08-17T02:49:58.054 INFO:tasks.ceph.mds.d.smithi161.stderr: -7207> 2024-08-17T02:47:42.343+0000 7f3d26800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:49:58.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:49:58.100 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2024-08-17T02:49:58.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.209+0000 7f6922e00640 1 Processor -- start 2024-08-17T02:49:58.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.209+0000 7f6922e00640 1 -- start start 2024-08-17T02:49:58.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.210+0000 7f6922e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f691c069000 0x7f691c069480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:58.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6922e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f691c0aedd0 0x7f691c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:58.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6922e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0ae330 con 0x7f691c158dd0 2024-08-17T02:49:58.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6922e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c0699c0 con 0x7f691c069000 2024-08-17T02:49:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6922e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c0aca50 con 0x7f691c0aedd0 2024-08-17T02:49:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f691c069000 0x7f691c069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f691c069000 0x7f691c069480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55788/0 (socket says 172.21.15.149:55788) 2024-08-17T02:49:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 -- 172.21.15.149:0/4275737131 learned_addr learned my addr 172.21.15.149:0/4275737131 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6922400640 1 --2- 172.21.15.149:0/4275737131 >> v2:172.21.15.161:3300/0 conn(0x7f691c0aedd0 0x7f691c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 -- 172.21.15.149:0/4275737131 >> v2:172.21.15.161:3300/0 conn(0x7f691c0aedd0 msgr2=0x7f691c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:58.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 --2- 172.21.15.149:0/4275737131 >> v2:172.21.15.161:3300/0 conn(0x7f691c0aedd0 0x7f691c0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 -- 172.21.15.149:0/4275737131 >> v1:172.21.15.161:6789/0 conn(0x7f691c158dd0 legacy=0x7f691c0abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:58.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.211+0000 7f6921000640 1 -- 172.21.15.149:0/4275737131 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0acd30 con 0x7f691c069000 2024-08-17T02:49:58.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.212+0000 7f6921000640 1 --2- 172.21.15.149:0/4275737131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c069480 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f691c064260 tx=0x7f69080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5da7c6a5ed6449b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f691be00640 1 -- 172.21.15.149:0/4275737131 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690802ae80 con 0x7f691c069000 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f691be00640 1 -- 172.21.15.149:0/4275737131 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908032440 con 0x7f691c069000 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f691be00640 1 -- 172.21.15.149:0/4275737131 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908032800 con 0x7f691c069000 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 -- 172.21.15.149:0/4275737131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 msgr2=0x7f691c069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 --2- 172.21.15.149:0/4275737131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c069480 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f691c064260 tx=0x7f69080091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 -- 172.21.15.149:0/4275737131 shutdown_connections 2024-08-17T02:49:58.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 --2- 172.21.15.149:0/4275737131 >> v2:172.21.15.161:3300/0 conn(0x7f691c0aedd0 0x7f691c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 --2- 172.21.15.149:0/4275737131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c069480 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 -- 172.21.15.149:0/4275737131 >> 172.21.15.149:0/4275737131 conn(0x7f691c096a70 msgr2=0x7f691c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:58.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 -- 172.21.15.149:0/4275737131 shutdown_connections 2024-08-17T02:49:58.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.213+0000 7f6922e00640 1 -- 172.21.15.149:0/4275737131 wait complete. 2024-08-17T02:49:58.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.215+0000 7f6922e00640 1 Processor -- start 2024-08-17T02:49:58.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.215+0000 7f6922e00640 1 -- start start 2024-08-17T02:49:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c16a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c0aedd0 0x7f691c16cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c158dd0 0x7f691c0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0cbb80 con 0x7f691c069000 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0cbe60 con 0x7f691c158dd0 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c16d270 con 0x7f691c0aedd0 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6921a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c16a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6921a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c16a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55792/0 (socket says 172.21.15.149:55792) 2024-08-17T02:49:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6921a00640 1 -- 172.21.15.149:0/2260087681 learned_addr learned my addr 172.21.15.149:0/2260087681 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:58.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6922400640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c158dd0 0x7f691c0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:58.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.216+0000 7f6921000640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c0aedd0 0x7f691c16cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:58.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921a00640 1 -- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c0aedd0 msgr2=0x7f691c16cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:58.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921a00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c0aedd0 0x7f691c16cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921a00640 1 -- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c158dd0 msgr2=0x7f691c0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921a00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c158dd0 0x7f691c0ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921a00640 1 -- 172.21.15.149:0/2260087681 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009450 con 0x7f691c069000 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921000640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c0aedd0 0x7f691c16cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6921a00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c16a210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f691000c4c0 tx=0x7f6910007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910011590 con 0x7f691c069000 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6910011710 con 0x7f691c069000 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c16d4d0 con 0x7f691c069000 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910011ad0 con 0x7f691c069000 2024-08-17T02:49:58.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.217+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c16da90 con 0x7f691c069000 2024-08-17T02:49:58.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.218+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c071050 con 0x7f691c069000 2024-08-17T02:49:58.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.219+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f691001b3b0 con 0x7f691c069000 2024-08-17T02:49:58.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.220+0000 7f6918c00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:58.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.220+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f6910081ce0 con 0x7f691c069000 2024-08-17T02:49:58.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.220+0000 7f6921000640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:58.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.221+0000 7f6921000640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f68fc065150 0x7f68fc067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6908034000 tx=0x7f6908032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:58.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.224+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f691004f9d0 con 0x7f691c069000 2024-08-17T02:49:58.434 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:58.433+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f691c06c590 con 0x7f691c069000 2024-08-17T02:49:59.042 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.042+0000 7f6918c00640 1 -- 172.21.15.149:0/2260087681 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6910017020 con 0x7f691c069000 2024-08-17T02:49:59.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.044+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f68fc065150 msgr2=0x7f68fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.044+0000 7f6922e00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f68fc065150 0x7f68fc067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6908034000 tx=0x7f6908032000 comp rx=0 tx=0).stop 2024-08-17T02:49:59.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.044+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 msgr2=0x7f691c16a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.045 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.044+0000 7f6922e00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c16a210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f691000c4c0 tx=0x7f6910007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 shutdown_connections 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f691c158dd0 0x7f691c0ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f691c0aedd0 0x7f691c16cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 --2- 172.21.15.149:0/2260087681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c069000 0x7f691c16a210 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 >> 172.21.15.149:0/2260087681 conn(0x7f691c096a70 msgr2=0x7f691c06b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 shutdown_connections 2024-08-17T02:49:59.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.045+0000 7f6922e00640 1 -- 172.21.15.149:0/2260087681 wait complete. 2024-08-17T02:49:59.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:49:59.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.213+0000 7f9cc9c00640 1 Processor -- start 2024-08-17T02:49:59.213 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.213+0000 7f9cc9c00640 1 -- start start 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc9c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9cc40af800 0x7f9cc4160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc9c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc4157840 con 0x7f9cc4155880 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc9c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc40aed40 con 0x7f9cc4155c50 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc9c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc4156c30 con 0x7f9cc40af800 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc3e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9cc4155880 0x7f9cc40ae630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54550/0 (socket says 172.21.15.149:54550) 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc3e00640 1 -- 172.21.15.149:0/1760675883 learned_addr learned my addr 172.21.15.149:0/1760675883 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:49:59.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.214+0000 7f9cc9200640 1 --2- 172.21.15.149:0/1760675883 >> v2:172.21.15.149:3300/0 conn(0x7f9cc40af800 0x7f9cc4160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:59.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.215+0000 7f9cc2a00640 1 -- 172.21.15.149:0/1760675883 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187040147 0 0) 0x7f9cc4157840 con 0x7f9cc4155880 2024-08-17T02:49:59.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.215+0000 7f9cc2a00640 1 -- 172.21.15.149:0/1760675883 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca80034e0 con 0x7f9cc4155880 2024-08-17T02:49:59.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.215+0000 7f9cc9200640 1 -- 172.21.15.149:0/1760675883 >> v1:172.21.15.161:6789/0 conn(0x7f9cc4155c50 legacy=0x7f9cc40af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.215+0000 7f9cc9200640 1 -- 172.21.15.149:0/1760675883 >> v1:172.21.15.149:6789/0 conn(0x7f9cc4155880 legacy=0x7f9cc40ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.215+0000 7f9cc9200640 1 -- 172.21.15.149:0/1760675883 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4156f10 con 0x7f9cc40af800 2024-08-17T02:49:59.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.216+0000 7f9cc9200640 1 --2- 172.21.15.149:0/1760675883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc40af800 0x7f9cc4160a50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009850 tx=0x7f9cbc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8143e6b41cb11c2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:59.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.216+0000 7f9cc2a00640 1 -- 172.21.15.149:0/1760675883 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc031510 con 0x7f9cc40af800 2024-08-17T02:49:59.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.216+0000 7f9cc2a00640 1 -- 172.21.15.149:0/1760675883 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc02f050 con 0x7f9cc40af800 2024-08-17T02:49:59.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.216+0000 7f9cc2a00640 1 -- 172.21.15.149:0/1760675883 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0318a0 con 0x7f9cc40af800 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 -- 172.21.15.149:0/1760675883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc40af800 msgr2=0x7f9cc4160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/1760675883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc40af800 0x7f9cc4160a50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009850 tx=0x7f9cbc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 -- 172.21.15.149:0/1760675883 shutdown_connections 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/1760675883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc40af800 0x7f9cc4160a50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 -- 172.21.15.149:0/1760675883 >> 172.21.15.149:0/1760675883 conn(0x7f9cc4067750 msgr2=0x7f9cc40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 -- 172.21.15.149:0/1760675883 shutdown_connections 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.217+0000 7f9cc9c00640 1 -- 172.21.15.149:0/1760675883 wait complete. 2024-08-17T02:49:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.218+0000 7f9cc9c00640 1 Processor -- start 2024-08-17T02:49:59.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.218+0000 7f9cc9c00640 1 -- start start 2024-08-17T02:49:59.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.219+0000 7f9cc9c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cc40af800 0x7f9cc414a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:59.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.219+0000 7f9cc9c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4155880 0x7f9cc414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:59.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.219+0000 7f9cc9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 0x7f9cc414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:59.221 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.219+0000 7f9cc9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc414bab0 con 0x7f9cc4155c50 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.219+0000 7f9cc9c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc414bd90 con 0x7f9cc4155880 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.219+0000 7f9cc9c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40c49c0 con 0x7f9cc40af800 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 0x7f9cc414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 0x7f9cc414c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55820/0 (socket says 172.21.15.149:55820) 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 -- 172.21.15.149:0/690647274 learned_addr learned my addr 172.21.15.149:0/690647274 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 -- 172.21.15.149:0/690647274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cc40af800 msgr2=0x7f9cc414a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cc40af800 0x7f9cc414a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 -- 172.21.15.149:0/690647274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4155880 msgr2=0x7f9cc414c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:59.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4155880 0x7f9cc414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 -- 172.21.15.149:0/690647274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc009390 con 0x7f9cc4155c50 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.220+0000 7f9cc9200640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 0x7f9cc414c7e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009360 tx=0x7f9cbc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.221+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc033aa0 con 0x7f9cc4155c50 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.221+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc033c00 con 0x7f9cc4155c50 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.221+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc03c430 con 0x7f9cc4155c50 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.221+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc40c4ca0 con 0x7f9cc4155c50 2024-08-17T02:49:59.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.221+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc414a850 con 0x7f9cc4155c50 2024-08-17T02:49:59.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.222+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc40c51a0 con 0x7f9cc4155c50 2024-08-17T02:49:59.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.222+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9cbc03c820 con 0x7f9cc4155c50 2024-08-17T02:49:59.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.223+0000 7f9cbb400640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9ca0065150 0x7f9ca0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:59.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.223+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f9cbc0a37a0 con 0x7f9cc4155c50 2024-08-17T02:49:59.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.223+0000 7f9cc3e00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9ca0065150 0x7f9ca0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:59.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.224+0000 7f9cc3e00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9ca0065150 0x7f9ca0067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4005bc0 tx=0x7f9cb40016e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:59.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.228+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9cbc071480 con 0x7f9cc4155c50 2024-08-17T02:49:59.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:49:59.398+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9cc4071050 con 0x7f9cc4155c50 2024-08-17T02:50:00.047 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.046+0000 7f9cbb400640 1 -- 172.21.15.149:0/690647274 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9cbc074aa0 con 0x7f9cc4155c50 2024-08-17T02:50:00.047 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:50:00.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9ca0065150 msgr2=0x7f9ca0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9ca0065150 0x7f9ca0067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4005bc0 tx=0x7f9cb40016e0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 msgr2=0x7f9cc414c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 0x7f9cc414c7e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009360 tx=0x7f9cbc037000 comp rx=0 tx=0).stop 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 shutdown_connections 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f9ca0065150 0x7f9ca0067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc4155c50 0x7f9cc414c7e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4155880 0x7f9cc414c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 --2- 172.21.15.149:0/690647274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cc40af800 0x7f9cc414a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 >> 172.21.15.149:0/690647274 conn(0x7f9cc4067750 msgr2=0x7f9cc406dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:00.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 shutdown_connections 2024-08-17T02:50:00.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.051+0000 7f9cc9c00640 1 -- 172.21.15.149:0/690647274 wait complete. 2024-08-17T02:50:00.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:50:00.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.230+0000 7f5a7e000640 1 Processor -- start 2024-08-17T02:50:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.230+0000 7f5a7e000640 1 -- start start 2024-08-17T02:50:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a780b2bb0 0x7f5a780b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7e000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780d0a80 con 0x7f5a7815c4b0 2024-08-17T02:50:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7e000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780b2130 con 0x7f5a780b5740 2024-08-17T02:50:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7e000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780b23f0 con 0x7f5a780b2bb0 2024-08-17T02:50:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7cc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a780b2bb0 0x7f5a780b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7d600640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5a7815c4b0 0x7f5a780aac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54552/0 (socket says 172.21.15.149:54552) 2024-08-17T02:50:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.231+0000 7f5a7d600640 1 -- 172.21.15.149:0/1933558229 learned_addr learned my addr 172.21.15.149:0/1933558229 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.232+0000 7f5a77400640 1 -- 172.21.15.149:0/1933558229 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964342954 0 0) 0x7f5a780b2130 con 0x7f5a780b5740 2024-08-17T02:50:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.232+0000 7f5a7cc00640 1 -- 172.21.15.149:0/1933558229 >> v1:172.21.15.161:6789/0 conn(0x7f5a780b5740 legacy=0x7f5a7815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.232+0000 7f5a7cc00640 1 -- 172.21.15.149:0/1933558229 >> v1:172.21.15.149:6789/0 conn(0x7f5a7815c4b0 legacy=0x7f5a780aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.232+0000 7f5a7cc00640 1 -- 172.21.15.149:0/1933558229 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780b37a0 con 0x7f5a780b2bb0 2024-08-17T02:50:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.233+0000 7f5a7cc00640 1 --2- 172.21.15.149:0/1933558229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b2bb0 0x7f5a780b2f80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009850 tx=0x7f5a6c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9933e4f9d7610bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a77400640 1 -- 172.21.15.149:0/1933558229 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c02ad10 con 0x7f5a780b2bb0 2024-08-17T02:50:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a77400640 1 -- 172.21.15.149:0/1933558229 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c02ae70 con 0x7f5a780b2bb0 2024-08-17T02:50:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a77400640 1 -- 172.21.15.149:0/1933558229 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c032650 con 0x7f5a780b2bb0 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a7e000640 1 -- 172.21.15.149:0/1933558229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b2bb0 msgr2=0x7f5a780b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a7e000640 1 --2- 172.21.15.149:0/1933558229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b2bb0 0x7f5a780b2f80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009850 tx=0x7f5a6c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a7e000640 1 -- 172.21.15.149:0/1933558229 shutdown_connections 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a7e000640 1 --2- 172.21.15.149:0/1933558229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b2bb0 0x7f5a780b2f80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.234+0000 7f5a7e000640 1 -- 172.21.15.149:0/1933558229 >> 172.21.15.149:0/1933558229 conn(0x7f5a780cfbc0 msgr2=0x7f5a780cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.235+0000 7f5a7e000640 1 -- 172.21.15.149:0/1933558229 shutdown_connections 2024-08-17T02:50:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.235+0000 7f5a7e000640 1 -- 172.21.15.149:0/1933558229 wait complete. 2024-08-17T02:50:00.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.236+0000 7f5a7e000640 1 Processor -- start 2024-08-17T02:50:00.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.236+0000 7f5a7e000640 1 -- start start 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.237+0000 7f5a7e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a780b2bb0 0x7f5a780c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.237+0000 7f5a7e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 0x7f5a7815e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.237+0000 7f5a7e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a7815c4b0 0x7f5a78159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.237+0000 7f5a7e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7809aa20 con 0x7f5a780b5740 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.237+0000 7f5a7e000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7809afe0 con 0x7f5a7815c4b0 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.237+0000 7f5a7e000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7809a1b0 con 0x7f5a780b2bb0 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 0x7f5a7815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 0x7f5a7815e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55838/0 (socket says 172.21.15.149:55838) 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 -- 172.21.15.149:0/108124985 learned_addr learned my addr 172.21.15.149:0/108124985 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a7cc00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a780b2bb0 0x7f5a780c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:00.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a7d600640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a7815c4b0 0x7f5a78159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:00.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 -- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a780b2bb0 msgr2=0x7f5a780c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a780b2bb0 0x7f5a780c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 -- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a7815c4b0 msgr2=0x7f5a78159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:00.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a7815c4b0 0x7f5a78159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:00.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.238+0000 7f5a77e00640 1 -- 172.21.15.149:0/108124985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009390 con 0x7f5a780b5740 2024-08-17T02:50:00.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.239+0000 7f5a77e00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 0x7f5a7815e580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c5b0 tx=0x7f5a64007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.239+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64012630 con 0x7f5a780b5740 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.239+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a640127b0 con 0x7f5a780b5740 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.239+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64012b70 con 0x7f5a780b5740 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.239+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7809a460 con 0x7f5a780b5740 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.239+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7809b5c0 con 0x7f5a780b5740 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.240+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78071050 con 0x7f5a780b5740 2024-08-17T02:50:00.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.241+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5a6401b400 con 0x7f5a780b5740 2024-08-17T02:50:00.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.242+0000 7f5a6be00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a58065180 0x7f5a58067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:00.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.242+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f5a64082110 con 0x7f5a780b5740 2024-08-17T02:50:00.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.242+0000 7f5a7cc00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a58065180 0x7f5a58067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:00.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.243+0000 7f5a7cc00640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a58065180 0x7f5a58067630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c034000 tx=0x7f5a6c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:00.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.246+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5a6404ffc0 con 0x7f5a780b5740 2024-08-17T02:50:00.430 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:00.429+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a78066ee0 con 0x7f5a780b5740 2024-08-17T02:50:01.058 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.057+0000 7f5a6be00640 1 -- 172.21.15.149:0/108124985 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a640535e0 con 0x7f5a780b5740 2024-08-17T02:50:01.061 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2024-08-17T02:50:01.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a58065180 msgr2=0x7f5a58067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a58065180 0x7f5a58067630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c034000 tx=0x7f5a6c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 msgr2=0x7f5a7815e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 0x7f5a7815e580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c5b0 tx=0x7f5a64007d60 comp rx=0 tx=0).stop 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 shutdown_connections 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a58065180 0x7f5a58067630 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a7815c4b0 0x7f5a78159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a780b5740 0x7f5a7815e580 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 --2- 172.21.15.149:0/108124985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a780b2bb0 0x7f5a780c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.062+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 >> 172.21.15.149:0/108124985 conn(0x7f5a780cfbc0 msgr2=0x7f5a780cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:01.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.063+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 shutdown_connections 2024-08-17T02:50:01.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.063+0000 7f5a7e000640 1 -- 172.21.15.149:0/108124985 wait complete. 2024-08-17T02:50:01.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.236+0000 7f0399800640 1 Processor -- start 2024-08-17T02:50:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.236+0000 7f0399800640 1 -- start start 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f0399800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0394156ad0 0x7f03940cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f0399800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0394156ea0 0x7f039406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f0399800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940caaf0 con 0x7f039406dab0 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f0399800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940ca900 con 0x7f0394156ea0 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f0399800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940cc560 con 0x7f0394156ad0 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f038b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0394156ea0 0x7f039406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f038b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0394156ea0 0x7f039406d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55850/0 (socket says 172.21.15.149:55850) 2024-08-17T02:50:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f038b400640 1 -- 172.21.15.149:0/800942846 learned_addr learned my addr 172.21.15.149:0/800942846 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.237+0000 7f0393e00640 1 --2- 172.21.15.149:0/800942846 >> v2:172.21.15.161:3300/0 conn(0x7f0394156ad0 0x7f03940cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.238+0000 7f038b400640 1 -- 172.21.15.149:0/800942846 >> v2:172.21.15.161:3300/0 conn(0x7f0394156ad0 msgr2=0x7f03940cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.238+0000 7f038b400640 1 --2- 172.21.15.149:0/800942846 >> v2:172.21.15.161:3300/0 conn(0x7f0394156ad0 0x7f03940cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.238+0000 7f038b400640 1 -- 172.21.15.149:0/800942846 >> v1:172.21.15.161:6789/0 conn(0x7f039406dab0 legacy=0x7f03940c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.238+0000 7f038b400640 1 -- 172.21.15.149:0/800942846 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394157300 con 0x7f0394156ea0 2024-08-17T02:50:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.239+0000 7f038b400640 1 --2- 172.21.15.149:0/800942846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f039406d570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0394065fd0 tx=0x7f037c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fecd9deae20f7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.239+0000 7f0393400640 1 -- 172.21.15.149:0/800942846 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c02ae60 con 0x7f0394156ea0 2024-08-17T02:50:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.239+0000 7f0393400640 1 -- 172.21.15.149:0/800942846 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c032440 con 0x7f0394156ea0 2024-08-17T02:50:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.239+0000 7f0393400640 1 -- 172.21.15.149:0/800942846 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0327e0 con 0x7f0394156ea0 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.239+0000 7f0399800640 1 -- 172.21.15.149:0/800942846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 msgr2=0x7f039406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.239+0000 7f0399800640 1 --2- 172.21.15.149:0/800942846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f039406d570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0394065fd0 tx=0x7f037c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.240+0000 7f0399800640 1 -- 172.21.15.149:0/800942846 shutdown_connections 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.240+0000 7f0399800640 1 --2- 172.21.15.149:0/800942846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f039406d570 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.240+0000 7f0399800640 1 --2- 172.21.15.149:0/800942846 >> v2:172.21.15.161:3300/0 conn(0x7f0394156ad0 0x7f03940cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.240+0000 7f0399800640 1 -- 172.21.15.149:0/800942846 >> 172.21.15.149:0/800942846 conn(0x7f0394067750 msgr2=0x7f03940cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.240+0000 7f0399800640 1 -- 172.21.15.149:0/800942846 shutdown_connections 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.240+0000 7f0399800640 1 -- 172.21.15.149:0/800942846 wait complete. 2024-08-17T02:50:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.241+0000 7f0399800640 1 Processor -- start 2024-08-17T02:50:01.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.241+0000 7f0399800640 1 -- start start 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0399800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f039406dab0 0x7f039416d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0399800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0394156ad0 0x7f03940a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0399800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f0394142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0399800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940a5d00 con 0x7f0394156ea0 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0399800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0394169030 con 0x7f039406dab0 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0399800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0394169b70 con 0x7f0394156ad0 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0398e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f0394142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0393e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f039406dab0 0x7f039416d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0398e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f0394142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55862/0 (socket says 172.21.15.149:55862) 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0398e00640 1 -- 172.21.15.149:0/3985070921 learned_addr learned my addr 172.21.15.149:0/3985070921 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f0393e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f039406dab0 0x7f039416d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:33824/0 (socket says 172.21.15.149:33824) 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.242+0000 7f038b400640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0394156ad0 0x7f03940a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0398e00640 1 -- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0394156ad0 msgr2=0x7f03940a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0398e00640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0394156ad0 0x7f03940a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0398e00640 1 -- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f039406dab0 msgr2=0x7f039416d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0398e00640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f039406dab0 0x7f039416d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0398e00640 1 -- 172.21.15.149:0/3985070921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c009450 con 0x7f0394156ea0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0398e00640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f0394142db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c860 tx=0x7f038c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00ce50 con 0x7f0394156ea0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00a850 con 0x7f0394156ea0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00ac10 con 0x7f0394156ea0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.243+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0394169240 con 0x7f0394156ea0 2024-08-17T02:50:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.244+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0394169800 con 0x7f0394156ea0 2024-08-17T02:50:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.245+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0394169ce0 con 0x7f0394156ea0 2024-08-17T02:50:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.245+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f038c003030 con 0x7f0394156ea0 2024-08-17T02:50:01.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.246+0000 7f038be00640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0370065150 0x7f0370067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.246+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f038c0822f0 con 0x7f0394156ea0 2024-08-17T02:50:01.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.246+0000 7f0393e00640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0370065150 0x7f0370067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.247+0000 7f0393e00640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0370065150 0x7f0370067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0394149ca0 tx=0x7f03840090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.250+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f038c0503e0 con 0x7f0394156ea0 2024-08-17T02:50:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.422+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0394071050 con 0x7f0394156ea0 2024-08-17T02:50:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.423+0000 7f038be00640 1 -- 172.21.15.149:0/3985070921 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15560 (secure 0 0 0) 0x7f038c053a00 con 0x7f0394156ea0 2024-08-17T02:50:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:01.424 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:50:01.053457+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6835/807513628":"2024-08-18T02:49:58.035874+0000","172.21.15.161:6833/807513628":"2024-08-18T02:49:58.035874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0370065150 msgr2=0x7f0370067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0370065150 0x7f0370067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0394149ca0 tx=0x7f03840090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 msgr2=0x7f0394142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f0394142db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c860 tx=0x7f038c001690 comp rx=0 tx=0).stop 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 shutdown_connections 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0370065150 0x7f0370067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0394156ea0 0x7f0394142db0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0394156ad0 0x7f03940a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 --2- 172.21.15.149:0/3985070921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f039406dab0 0x7f039416d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 >> 172.21.15.149:0/3985070921 conn(0x7f0394067750 msgr2=0x7f03940ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 shutdown_connections 2024-08-17T02:50:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.425+0000 7f0399800640 1 -- 172.21.15.149:0/3985070921 wait complete. 2024-08-17T02:50:01.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:35.676784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000066836.meta', 'create_time': '2024-08-17T02:47:48.713066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000066836'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000066836.data', 'create_time': '2024-08-17T02:47:49.612933+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000066836'}}}] 2024-08-17T02:50:01.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:50:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.594+0000 7f2d34e00640 1 Processor -- start 2024-08-17T02:50:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.594+0000 7f2d34e00640 1 -- start start 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d34e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d300b0a80 0x7f2d300b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d34e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d30157070 con 0x7f2d30157e10 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d34e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3015b410 con 0x7f2d300adec0 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d34e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300b1390 con 0x7f2d300b0a80 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d2d400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2d30157e10 0x7f2d300ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54566/0 (socket says 172.21.15.149:54566) 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d2d400640 1 -- 172.21.15.149:0/2347969753 learned_addr learned my addr 172.21.15.149:0/2347969753 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.595+0000 7f2d2de00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d300b0a80 0x7f2d300b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.596+0000 7f2d2de00640 1 -- 172.21.15.149:0/2347969753 >> v1:172.21.15.161:6789/0 conn(0x7f2d300adec0 legacy=0x7f2d3015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.596+0000 7f2d2de00640 1 -- 172.21.15.149:0/2347969753 >> v1:172.21.15.149:6789/0 conn(0x7f2d30157e10 legacy=0x7f2d300ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.596+0000 7f2d2ca00640 1 -- 172.21.15.149:0/2347969753 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710404531 0 0) 0x7f2d30157070 con 0x7f2d30157e10 2024-08-17T02:50:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.596+0000 7f2d2de00640 1 -- 172.21.15.149:0/2347969753 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30157330 con 0x7f2d300b0a80 2024-08-17T02:50:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.597+0000 7f2d2de00640 1 --2- 172.21.15.149:0/2347969753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300b0a80 0x7f2d300b0e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009850 tx=0x7f2d200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d56ace7b5a4b47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.597+0000 7f2d2ca00640 1 -- 172.21.15.149:0/2347969753 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2002ad90 con 0x7f2d300b0a80 2024-08-17T02:50:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.597+0000 7f2d2ca00640 1 -- 172.21.15.149:0/2347969753 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20032440 con 0x7f2d300b0a80 2024-08-17T02:50:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.597+0000 7f2d2ca00640 1 -- 172.21.15.149:0/2347969753 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200327e0 con 0x7f2d300b0a80 2024-08-17T02:50:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 -- 172.21.15.149:0/2347969753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300b0a80 msgr2=0x7f2d300b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2347969753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300b0a80 0x7f2d300b0e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009850 tx=0x7f2d200090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 -- 172.21.15.149:0/2347969753 shutdown_connections 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2347969753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300b0a80 0x7f2d300b0e50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 -- 172.21.15.149:0/2347969753 >> 172.21.15.149:0/2347969753 conn(0x7f2d30067750 msgr2=0x7f2d300cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 -- 172.21.15.149:0/2347969753 shutdown_connections 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.598+0000 7f2d34e00640 1 -- 172.21.15.149:0/2347969753 wait complete. 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.599+0000 7f2d34e00640 1 Processor -- start 2024-08-17T02:50:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.599+0000 7f2d34e00640 1 -- start start 2024-08-17T02:50:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d34e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 0x7f2d3014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d34e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d300b0a80 0x7f2d3015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d34e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d30157e10 0x7f2d3015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d34e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014e700 con 0x7f2d300adec0 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d34e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014ecc0 con 0x7f2d30157e10 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d34e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014e4a0 con 0x7f2d300b0a80 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d2de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 0x7f2d3014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d2de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 0x7f2d3014d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55870/0 (socket says 172.21.15.149:55870) 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.600+0000 7f2d2de00640 1 -- 172.21.15.149:0/2547185454 learned_addr learned my addr 172.21.15.149:0/2547185454 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2e800640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d30157e10 0x7f2d3015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2d400640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d300b0a80 0x7f2d3015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2de00640 1 -- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d300b0a80 msgr2=0x7f2d3015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2de00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d300b0a80 0x7f2d3015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2de00640 1 -- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d30157e10 msgr2=0x7f2d3015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2de00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d30157e10 0x7f2d3015c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2de00640 1 -- 172.21.15.149:0/2547185454 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20009390 con 0x7f2d300adec0 2024-08-17T02:50:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d2de00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 0x7f2d3014d3d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009360 tx=0x7f2d20032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20031b30 con 0x7f2d300adec0 2024-08-17T02:50:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20031cd0 con 0x7f2d300adec0 2024-08-17T02:50:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2003d670 con 0x7f2d300adec0 2024-08-17T02:50:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.601+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3015cd80 con 0x7f2d300adec0 2024-08-17T02:50:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.602+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3014e950 con 0x7f2d300adec0 2024-08-17T02:50:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.603+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d30064db0 con 0x7f2d300adec0 2024-08-17T02:50:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.603+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2d20039040 con 0x7f2d300adec0 2024-08-17T02:50:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.604+0000 7f2d25600640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d10065150 0x7f2d10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.604+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2d200a21a0 con 0x7f2d300adec0 2024-08-17T02:50:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.604+0000 7f2d2d400640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d10065150 0x7f2d10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.605+0000 7f2d2d400640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d10065150 0x7f2d10067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2d300cc450 tx=0x7f2d1c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.608 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.608+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2d200701e0 con 0x7f2d300adec0 2024-08-17T02:50:01.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.782+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d30159d60 con 0x7f2d300adec0 2024-08-17T02:50:01.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.783+0000 7f2d25600640 1 -- 172.21.15.149:0/2547185454 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d20073800 con 0x7f2d300adec0 2024-08-17T02:50:01.783 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d10065150 msgr2=0x7f2d10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d10065150 0x7f2d10067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2d300cc450 tx=0x7f2d1c009040 comp rx=0 tx=0).stop 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 msgr2=0x7f2d3014d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 0x7f2d3014d3d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009360 tx=0x7f2d20032000 comp rx=0 tx=0).stop 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 shutdown_connections 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2d10065150 0x7f2d10067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d30157e10 0x7f2d3015c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d300b0a80 0x7f2d3015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 --2- 172.21.15.149:0/2547185454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d300adec0 0x7f2d3014d3d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 >> 172.21.15.149:0/2547185454 conn(0x7f2d30067750 msgr2=0x7f2d300cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:01.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 shutdown_connections 2024-08-17T02:50:01.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.785+0000 7f2d34e00640 1 -- 172.21.15.149:0/2547185454 wait complete. 2024-08-17T02:50:01.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000066836.meta pg_num 2024-08-17T02:50:01.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.950+0000 7f1533e00640 1 Processor -- start 2024-08-17T02:50:01.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.950+0000 7f1533e00640 1 -- start start 2024-08-17T02:50:01.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1533e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1534155660 0x7f15340c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1533e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15340afc40 con 0x7f1534155a30 2024-08-17T02:50:01.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1533e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15340af030 con 0x7f15340adfb0 2024-08-17T02:50:01.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1533e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15340af310 con 0x7f1534155660 2024-08-17T02:50:01.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1533400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1534155a30 0x7f153406dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54580/0 (socket says 172.21.15.149:54580) 2024-08-17T02:50:01.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1533400640 1 -- 172.21.15.149:0/2738590346 learned_addr learned my addr 172.21.15.149:0/2738590346 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:01.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1532a00640 1 --2- 172.21.15.149:0/2738590346 >> v2:172.21.15.149:3300/0 conn(0x7f1534155660 0x7f15340c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1532000640 1 -- 172.21.15.149:0/2738590346 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804306185 0 0) 0x7f15340afc40 con 0x7f1534155a30 2024-08-17T02:50:01.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.952+0000 7f1532000640 1 -- 172.21.15.149:0/2738590346 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15180034e0 con 0x7f1534155a30 2024-08-17T02:50:01.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.953+0000 7f1532a00640 1 -- 172.21.15.149:0/2738590346 >> v1:172.21.15.161:6789/0 conn(0x7f15340adfb0 legacy=0x7f15340ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.953+0000 7f1532a00640 1 -- 172.21.15.149:0/2738590346 >> v1:172.21.15.149:6789/0 conn(0x7f1534155a30 legacy=0x7f153406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.953+0000 7f1532a00640 1 -- 172.21.15.149:0/2738590346 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340af5f0 con 0x7f1534155660 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1532a00640 1 --2- 172.21.15.149:0/2738590346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340c7fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1524009850 tx=0x7f15240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30771b62757206fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1532000640 1 -- 172.21.15.149:0/2738590346 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152402ae20 con 0x7f1534155660 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1532000640 1 -- 172.21.15.149:0/2738590346 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1524032440 con 0x7f1534155660 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1532000640 1 -- 172.21.15.149:0/2738590346 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240327e0 con 0x7f1534155660 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1533e00640 1 -- 172.21.15.149:0/2738590346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 msgr2=0x7f15340c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1533e00640 1 --2- 172.21.15.149:0/2738590346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340c7fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1524009850 tx=0x7f15240090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1533e00640 1 -- 172.21.15.149:0/2738590346 shutdown_connections 2024-08-17T02:50:01.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1533e00640 1 --2- 172.21.15.149:0/2738590346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340c7fe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1533e00640 1 -- 172.21.15.149:0/2738590346 >> 172.21.15.149:0/2738590346 conn(0x7f1534066cd0 msgr2=0x7f15340670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:01.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.954+0000 7f1533e00640 1 -- 172.21.15.149:0/2738590346 shutdown_connections 2024-08-17T02:50:01.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.955+0000 7f1533e00640 1 -- 172.21.15.149:0/2738590346 wait complete. 2024-08-17T02:50:01.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.956+0000 7f1533e00640 1 Processor -- start 2024-08-17T02:50:01.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.956+0000 7f1533e00640 1 -- start start 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15340adfb0 0x7f15340aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1534155a30 0x7f1534142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340a6da0 con 0x7f1534155660 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340a7080 con 0x7f1534155a30 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15340aae50 con 0x7f15340adfb0 2024-08-17T02:50:01.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f152a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f152a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55888/0 (socket says 172.21.15.149:55888) 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f152a000640 1 -- 172.21.15.149:0/3135970960 learned_addr learned my addr 172.21.15.149:0/3135970960 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1533400640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1534155a30 0x7f1534142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.957+0000 7f1532a00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15340adfb0 0x7f15340aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152a000640 1 -- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15340adfb0 msgr2=0x7f15340aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152a000640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15340adfb0 0x7f15340aa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152a000640 1 -- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1534155a30 msgr2=0x7f1534142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152a000640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1534155a30 0x7f1534142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152a000640 1 -- 172.21.15.149:0/3135970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009390 con 0x7f1534155660 2024-08-17T02:50:01.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152a000640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340aa570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f151c00c5c0 tx=0x7f151c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c011590 con 0x7f1534155660 2024-08-17T02:50:01.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c011710 con 0x7f1534155660 2024-08-17T02:50:01.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15340ab130 con 0x7f1534155660 2024-08-17T02:50:01.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c011ad0 con 0x7f1534155660 2024-08-17T02:50:01.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.958+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15340aaab0 con 0x7f1534155660 2024-08-17T02:50:01.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.959+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1534071050 con 0x7f1534155660 2024-08-17T02:50:01.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.960+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f151c01b3b0 con 0x7f1534155660 2024-08-17T02:50:01.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.961+0000 7f152aa00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1510065150 0x7f1510067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:01.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.961+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f151c081990 con 0x7f1534155660 2024-08-17T02:50:01.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.961+0000 7f1532a00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1510065150 0x7f1510067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:01.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.962+0000 7f1532a00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1510065150 0x7f1510067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1524034000 tx=0x7f1524032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:01.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:01.965+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f151c04f9e0 con 0x7f1534155660 2024-08-17T02:50:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.136+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.meta", "var": "pg_num"} v 0) v1 -- 0x7f15340a71c0 con 0x7f1534155660 2024-08-17T02:50:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.137+0000 7f152aa00640 1 -- 172.21.15.149:0/3135970960 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.meta", "var": "pg_num"}]=0 v42) v1 ==== 124+0+11 (secure 0 0 0) 0x7f151c017070 con 0x7f1534155660 2024-08-17T02:50:02.137 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1510065150 msgr2=0x7f1510067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1510065150 0x7f1510067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1524034000 tx=0x7f1524032000 comp rx=0 tx=0).stop 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 msgr2=0x7f15340aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340aa570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f151c00c5c0 tx=0x7f151c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 shutdown_connections 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f1510065150 0x7f1510067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1534155a30 0x7f1534142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1534155660 0x7f15340aa570 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 --2- 172.21.15.149:0/3135970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15340adfb0 0x7f15340aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 >> 172.21.15.149:0/3135970960 conn(0x7f1534066cd0 msgr2=0x7f1534069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:02.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 shutdown_connections 2024-08-17T02:50:02.141 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.139+0000 7f1533e00640 1 -- 172.21.15.149:0/3135970960 wait complete. 2024-08-17T02:50:02.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000066836.data pg_num 2024-08-17T02:50:02.305 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.305+0000 7f2fbb200640 1 Processor -- start 2024-08-17T02:50:02.305 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.305+0000 7f2fbb200640 1 -- start start 2024-08-17T02:50:02.306 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fbb200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2fb4069600 0x7f2fb40af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fbb200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb40ae3a0 con 0x7f2fb4069230 2024-08-17T02:50:02.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fbb200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb40ac770 con 0x7f2fb4096e70 2024-08-17T02:50:02.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fbb200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb4069a00 con 0x7f2fb4069600 2024-08-17T02:50:02.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fb9e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2fb4069230 0x7f2fb40abfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54582/0 (socket says 172.21.15.149:54582) 2024-08-17T02:50:02.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fb9e00640 1 -- 172.21.15.149:0/233550753 learned_addr learned my addr 172.21.15.149:0/233550753 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:02.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.306+0000 7f2fba800640 1 --2- 172.21.15.149:0/233550753 >> v2:172.21.15.149:3300/0 conn(0x7f2fb4069600 0x7f2fb40af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.307+0000 7f2fb8a00640 1 -- 172.21.15.149:0/233550753 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753028123 0 0) 0x7f2fb40ae3a0 con 0x7f2fb4069230 2024-08-17T02:50:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.307+0000 7f2fb8a00640 1 -- 172.21.15.149:0/233550753 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f9c0034e0 con 0x7f2fb4069230 2024-08-17T02:50:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.307+0000 7f2fba800640 1 -- 172.21.15.149:0/233550753 >> v1:172.21.15.161:6789/0 conn(0x7f2fb4096e70 legacy=0x7f2fb40aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.307+0000 7f2fba800640 1 -- 172.21.15.149:0/233550753 >> v1:172.21.15.149:6789/0 conn(0x7f2fb4069230 legacy=0x7f2fb40abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.307+0000 7f2fba800640 1 -- 172.21.15.149:0/233550753 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb40aca50 con 0x7f2fb4069600 2024-08-17T02:50:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.308+0000 7f2fba800640 1 --2- 172.21.15.149:0/233550753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb40af270 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009e60 tx=0x7f2fb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c1b0b7bb6bf9ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.308+0000 7f2fb8a00640 1 -- 172.21.15.149:0/233550753 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0007550 con 0x7f2fb4069600 2024-08-17T02:50:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.308+0000 7f2fb8a00640 1 -- 172.21.15.149:0/233550753 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb002d050 con 0x7f2fb4069600 2024-08-17T02:50:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.308+0000 7f2fb8a00640 1 -- 172.21.15.149:0/233550753 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00078c0 con 0x7f2fb4069600 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 -- 172.21.15.149:0/233550753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 msgr2=0x7f2fb40af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 --2- 172.21.15.149:0/233550753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb40af270 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009e60 tx=0x7f2fb0009780 comp rx=0 tx=0).stop 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 -- 172.21.15.149:0/233550753 shutdown_connections 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 --2- 172.21.15.149:0/233550753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb40af270 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 -- 172.21.15.149:0/233550753 >> 172.21.15.149:0/233550753 conn(0x7f2fb4096a70 msgr2=0x7f2fb40cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 -- 172.21.15.149:0/233550753 shutdown_connections 2024-08-17T02:50:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.309+0000 7f2fbb200640 1 -- 172.21.15.149:0/233550753 wait complete. 2024-08-17T02:50:02.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.310+0000 7f2fbb200640 1 Processor -- start 2024-08-17T02:50:02.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.310+0000 7f2fbb200640 1 -- start start 2024-08-17T02:50:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fbb200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb4069230 0x7f2fb413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fbb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fbb200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fb4096e70 0x7f2fb4169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fbb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb415ec60 con 0x7f2fb4069600 2024-08-17T02:50:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fbb200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40b1740 con 0x7f2fb4069230 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fbb200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4140200 con 0x7f2fb4096e70 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.311+0000 7f2fb9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55910/0 (socket says 172.21.15.149:55910) 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 -- 172.21.15.149:0/2456011599 learned_addr learned my addr 172.21.15.149:0/2456011599 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9e00640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb4069230 0x7f2fb413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fba800640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fb4096e70 0x7f2fb4169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 -- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fb4096e70 msgr2=0x7f2fb4169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fb4096e70 0x7f2fb4169090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 -- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb4069230 msgr2=0x7f2fb413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb4069230 0x7f2fb413fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 -- 172.21.15.149:0/2456011599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009a20 con 0x7f2fb4069600 2024-08-17T02:50:02.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fba800640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fb4096e70 0x7f2fb4169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:02.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fb9400640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb415c490 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c520 tx=0x7f2fa4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:02.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4011590 con 0x7f2fb4069600 2024-08-17T02:50:02.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa4011710 con 0x7f2fb4069600 2024-08-17T02:50:02.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.312+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb4169fa0 con 0x7f2fb4069600 2024-08-17T02:50:02.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.313+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4011ad0 con 0x7f2fb4069600 2024-08-17T02:50:02.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.313+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb415f190 con 0x7f2fb4069600 2024-08-17T02:50:02.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.314+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb40b1910 con 0x7f2fb4069600 2024-08-17T02:50:02.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.314+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2fa401b3b0 con 0x7f2fb4069600 2024-08-17T02:50:02.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.315+0000 7f2fad600640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f98065180 0x7f2f98067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.315+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2fa4081960 con 0x7f2fb4069600 2024-08-17T02:50:02.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.316+0000 7f2fb9e00640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f98065180 0x7f2f98067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.316+0000 7f2fb9e00640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f98065180 0x7f2f98067630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2fb416c5d0 tx=0x7f2fa8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:02.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.319+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2fb40b1910 con 0x7f2fb4069600 2024-08-17T02:50:02.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.490+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.data", "var": "pg_num"} v 0) v1 -- 0x7f2fb40b1910 con 0x7f2fb4069600 2024-08-17T02:50:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.490+0000 7f2fad600640 1 -- 172.21.15.149:0/2456011599 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000066836.data", "var": "pg_num"}]=0 v42) v1 ==== 124+0+11 (secure 0 0 0) 0x7f2fb40b1910 con 0x7f2fb4069600 2024-08-17T02:50:02.491 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2024-08-17T02:50:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.492+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f98065180 msgr2=0x7f2f98067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.492+0000 7f2fbb200640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f98065180 0x7f2f98067630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2fb416c5d0 tx=0x7f2fa8009040 comp rx=0 tx=0).stop 2024-08-17T02:50:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.492+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 msgr2=0x7f2fb415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.492+0000 7f2fbb200640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb415c490 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c520 tx=0x7f2fa4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 shutdown_connections 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f2f98065180 0x7f2f98067630 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fb4096e70 0x7f2fb4169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb4069600 0x7f2fb415c490 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 --2- 172.21.15.149:0/2456011599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb4069230 0x7f2fb413fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 >> 172.21.15.149:0/2456011599 conn(0x7f2fb4096a70 msgr2=0x7f2fb4157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 shutdown_connections 2024-08-17T02:50:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.493+0000 7f2fbb200640 1 -- 172.21.15.149:0/2456011599 wait complete. 2024-08-17T02:50:02.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:02.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.657+0000 7fb36b200640 1 Processor -- start 2024-08-17T02:50:02.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.657+0000 7fb36b200640 1 -- start start 2024-08-17T02:50:02.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb36b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0ce8a0 0x7fb36c0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb36b200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb36c0c5c40 0x7fb36c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb36b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c0cc890 con 0x7fb36c0aed50 2024-08-17T02:50:02.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb36b200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c0cb230 con 0x7fb36c0c5c40 2024-08-17T02:50:02.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb36b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0cb4c0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb369e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb36c0aed50 0x7fb36c0ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54588/0 (socket says 172.21.15.149:54588) 2024-08-17T02:50:02.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.658+0000 7fb369e00640 1 -- 172.21.15.149:0/1558823850 learned_addr learned my addr 172.21.15.149:0/1558823850 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb369400640 1 --2- 172.21.15.149:0/1558823850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0ce8a0 0x7fb36c0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb36a800640 1 --2- 172.21.15.149:0/1558823850 >> v2:172.21.15.161:3300/0 conn(0x7fb36c0c5c40 0x7fb36c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb368a00640 1 -- 172.21.15.149:0/1558823850 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854151579 0 0) 0x7fb36c0cc890 con 0x7fb36c0aed50 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb368a00640 1 -- 172.21.15.149:0/1558823850 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3500034e0 con 0x7fb36c0aed50 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb369400640 1 -- 172.21.15.149:0/1558823850 >> v2:172.21.15.161:3300/0 conn(0x7fb36c0c5c40 msgr2=0x7fb36c0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb369400640 1 --2- 172.21.15.149:0/1558823850 >> v2:172.21.15.161:3300/0 conn(0x7fb36c0c5c40 0x7fb36c0cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb369400640 1 -- 172.21.15.149:0/1558823850 >> v1:172.21.15.149:6789/0 conn(0x7fb36c0aed50 legacy=0x7fb36c0ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb369400640 1 -- 172.21.15.149:0/1558823850 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0cb7a0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.659+0000 7fb36a800640 1 --2- 172.21.15.149:0/1558823850 >> v2:172.21.15.161:3300/0 conn(0x7fb36c0c5c40 0x7fb36c0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.660+0000 7fb369400640 1 --2- 172.21.15.149:0/1558823850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0ce8a0 0x7fb36c0ca7b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb358009850 tx=0x7fb3580090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a8cf7cfafaa0a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb368a00640 1 -- 172.21.15.149:0/1558823850 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35802ad80 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb368a00640 1 -- 172.21.15.149:0/1558823850 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358032440 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb368a00640 1 -- 172.21.15.149:0/1558823850 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358032800 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 -- 172.21.15.149:0/1558823850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0ce8a0 msgr2=0x7fb36c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 --2- 172.21.15.149:0/1558823850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0ce8a0 0x7fb36c0ca7b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb358009850 tx=0x7fb3580090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 -- 172.21.15.149:0/1558823850 shutdown_connections 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 --2- 172.21.15.149:0/1558823850 >> v2:172.21.15.161:3300/0 conn(0x7fb36c0c5c40 0x7fb36c0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 --2- 172.21.15.149:0/1558823850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0ce8a0 0x7fb36c0ca7b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 -- 172.21.15.149:0/1558823850 >> 172.21.15.149:0/1558823850 conn(0x7fb36c098e30 msgr2=0x7fb36c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:02.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 -- 172.21.15.149:0/1558823850 shutdown_connections 2024-08-17T02:50:02.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.661+0000 7fb36b200640 1 -- 172.21.15.149:0/1558823850 wait complete. 2024-08-17T02:50:02.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.663+0000 7fb36b200640 1 Processor -- start 2024-08-17T02:50:02.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.663+0000 7fb36b200640 1 -- start start 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36b200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb36c0aed50 0x7fb36c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0c5c40 0x7fb36c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 0x7fb36c067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1557c0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36b200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0c71a0 con 0x7fb36c0aed50 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0c73d0 con 0x7fb36c0c5c40 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 0x7fb36c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 0x7fb36c067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55922/0 (socket says 172.21.15.149:55922) 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb36a800640 1 -- 172.21.15.149:0/194287815 learned_addr learned my addr 172.21.15.149:0/194287815 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb369400640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0c5c40 0x7fb36c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.664+0000 7fb369e00640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb36c0aed50 0x7fb36c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36a800640 1 -- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0c5c40 msgr2=0x7fb36c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36a800640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0c5c40 0x7fb36c0c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36a800640 1 -- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb36c0aed50 msgr2=0x7fb36c155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36a800640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb36c0aed50 0x7fb36c155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36a800640 1 -- 172.21.15.149:0/194287815 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364009a20 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36a800640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 0x7fb36c067340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb364009f20 tx=0x7fb36400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:02.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400ce10 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36400f040 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb358009390 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640146d0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.665+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c0c7990 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.666+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c071050 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.667+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb364003020 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.668+0000 7fb361600640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb34c065150 0x7fb34c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:02.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.668+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fb364082e80 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.668+0000 7fb369e00640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb34c065150 0x7fb34c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:02.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.669+0000 7fb369e00640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb34c065150 0x7fb34c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb35c005840 tx=0x7fb35c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:02.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.672+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb364050ed0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.884 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.883+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb36c0cdaa0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.884 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.884+0000 7fb361600640 1 -- 172.21.15.149:0/194287815 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4624 (secure 0 0 0) 0x7fb3640544f0 con 0x7fb36c0ce8a0 2024-08-17T02:50:02.885 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:02.885 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1907492324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":1907492324},{"type":"v1","addr":"172.21.15.161:6835","nonce":1907492324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 23 2024-08-17T02:50:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb34c065150 msgr2=0x7fb34c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb34c065150 0x7fb34c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb35c005840 tx=0x7fb35c009040 comp rx=0 tx=0).stop 2024-08-17T02:50:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 msgr2=0x7fb36c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 0x7fb36c067340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb364009f20 tx=0x7fb36400b040 comp rx=0 tx=0).stop 2024-08-17T02:50:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 shutdown_connections 2024-08-17T02:50:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb34c065150 0x7fb34c067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb36c0ce8a0 0x7fb36c067340 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb36c0c5c40 0x7fb36c0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 --2- 172.21.15.149:0/194287815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb36c0aed50 0x7fb36c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 >> 172.21.15.149:0/194287815 conn(0x7fb36c098e30 msgr2=0x7fb36c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 shutdown_connections 2024-08-17T02:50:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:02.886+0000 7fb36b200640 1 -- 172.21.15.149:0/194287815 wait complete. 2024-08-17T02:50:02.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.050+0000 7f47f1a00640 1 Processor -- start 2024-08-17T02:50:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.051+0000 7f47f1a00640 1 -- start start 2024-08-17T02:50:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47f1a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f47ec1401b0 0x7f47ec0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47f1a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47ec140580 0x7f47ec0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47f1a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0b16d0 con 0x7f47ec0b1270 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47f1a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0cb450 con 0x7f47ec140580 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47f1a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0caa80 con 0x7f47ec1401b0 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47e2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47ec140580 0x7f47ec0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47e2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47ec140580 0x7f47ec0b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55938/0 (socket says 172.21.15.149:55938) 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47e2000640 1 -- 172.21.15.149:0/787018855 learned_addr learned my addr 172.21.15.149:0/787018855 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.052+0000 7f47eaa00640 1 --2- 172.21.15.149:0/787018855 >> v2:172.21.15.161:3300/0 conn(0x7f47ec1401b0 0x7f47ec0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.053+0000 7f47e2000640 1 -- 172.21.15.149:0/787018855 >> v2:172.21.15.161:3300/0 conn(0x7f47ec1401b0 msgr2=0x7f47ec0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:03.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.053+0000 7f47e2000640 1 --2- 172.21.15.149:0/787018855 >> v2:172.21.15.161:3300/0 conn(0x7f47ec1401b0 0x7f47ec0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.053+0000 7f47e2000640 1 -- 172.21.15.149:0/787018855 >> v1:172.21.15.161:6789/0 conn(0x7f47ec0b1270 legacy=0x7f47ec0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.053+0000 7f47e2000640 1 -- 172.21.15.149:0/787018855 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0c9e70 con 0x7f47ec140580 2024-08-17T02:50:03.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.054+0000 7f47e2000640 1 --2- 172.21.15.149:0/787018855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec140580 0x7f47ec0b0d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f47ec068650 tx=0x7f47d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6234e1ff76c55f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.054+0000 7f47ea000640 1 -- 172.21.15.149:0/787018855 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d402adf0 con 0x7f47ec140580 2024-08-17T02:50:03.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.054+0000 7f47ea000640 1 -- 172.21.15.149:0/787018855 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4032440 con 0x7f47ec140580 2024-08-17T02:50:03.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.054+0000 7f47ea000640 1 -- 172.21.15.149:0/787018855 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4032820 con 0x7f47ec140580 2024-08-17T02:50:03.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.054+0000 7f47f1a00640 1 -- 172.21.15.149:0/787018855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec140580 msgr2=0x7f47ec0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.054+0000 7f47f1a00640 1 --2- 172.21.15.149:0/787018855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec140580 0x7f47ec0b0d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f47ec068650 tx=0x7f47d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.055+0000 7f47f1a00640 1 -- 172.21.15.149:0/787018855 shutdown_connections 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.055+0000 7f47f1a00640 1 --2- 172.21.15.149:0/787018855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec140580 0x7f47ec0b0d30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.055+0000 7f47f1a00640 1 --2- 172.21.15.149:0/787018855 >> v2:172.21.15.161:3300/0 conn(0x7f47ec1401b0 0x7f47ec0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.055+0000 7f47f1a00640 1 -- 172.21.15.149:0/787018855 >> 172.21.15.149:0/787018855 conn(0x7f47ec0cb9b0 msgr2=0x7f47ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.055+0000 7f47f1a00640 1 -- 172.21.15.149:0/787018855 shutdown_connections 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.055+0000 7f47f1a00640 1 -- 172.21.15.149:0/787018855 wait complete. 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.056+0000 7f47f1a00640 1 Processor -- start 2024-08-17T02:50:03.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.056+0000 7f47f1a00640 1 -- start start 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47f1a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47ec0b1270 0x7f47ec0a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47f1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 0x7f47ec0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47f1a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47ec140580 0x7f47ec168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47f1a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0ac2f0 con 0x7f47ec1401b0 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47f1a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0abab0 con 0x7f47ec140580 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47f1a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0abd30 con 0x7f47ec0b1270 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47e2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 0x7f47ec0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47e2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 0x7f47ec0ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55948/0 (socket says 172.21.15.149:55948) 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47e2000640 1 -- 172.21.15.149:0/1562969794 learned_addr learned my addr 172.21.15.149:0/1562969794 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47eaa00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47ec0b1270 0x7f47ec0a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.057+0000 7f47eb400640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47ec140580 0x7f47ec168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2000640 1 -- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47ec0b1270 msgr2=0x7f47ec0a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2000640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47ec0b1270 0x7f47ec0a9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2000640 1 -- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47ec140580 msgr2=0x7f47ec168cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2000640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47ec140580 0x7f47ec168cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2000640 1 -- 172.21.15.149:0/1562969794 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009450 con 0x7f47ec1401b0 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47eb400640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47ec140580 0x7f47ec168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2000640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 0x7f47ec0ab570 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009940 tx=0x7f47d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4031a60 con 0x7f47ec1401b0 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4031be0 con 0x7f47ec1401b0 2024-08-17T02:50:03.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d403d420 con 0x7f47ec1401b0 2024-08-17T02:50:03.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0ac010 con 0x7f47ec1401b0 2024-08-17T02:50:03.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.058+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec0aefa0 con 0x7f47ec1401b0 2024-08-17T02:50:03.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.059+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec0aeb20 con 0x7f47ec1401b0 2024-08-17T02:50:03.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.060+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47d4039040 con 0x7f47ec1401b0 2024-08-17T02:50:03.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.061+0000 7f47e2a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f47c8065150 0x7f47c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.061+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f47d40a2450 con 0x7f47ec1401b0 2024-08-17T02:50:03.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.061+0000 7f47eaa00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f47c8065150 0x7f47c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.062+0000 7f47eaa00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f47c8065150 0x7f47c8067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d20 tx=0x7f47dc0090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.066+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f47ec0aeb20 con 0x7f47ec1401b0 2024-08-17T02:50:03.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.238+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47ec0af1e0 con 0x7f47ec1401b0 2024-08-17T02:50:03.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.239+0000 7f47e2a00640 1 -- 172.21.15.149:0/1562969794 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15560 (secure 0 0 0) 0x7f47ec0af1e0 con 0x7f47ec1401b0 2024-08-17T02:50:03.240 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:03.240 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:50:01.053457+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6835/807513628":"2024-08-18T02:49:58.035874+0000","172.21.15.161:6833/807513628":"2024-08-18T02:49:58.035874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:03.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f47c8065150 msgr2=0x7f47c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f47c8065150 0x7f47c8067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d20 tx=0x7f47dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 msgr2=0x7f47ec0ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 0x7f47ec0ab570 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009940 tx=0x7f47d4032000 comp rx=0 tx=0).stop 2024-08-17T02:50:03.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 shutdown_connections 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f47c8065150 0x7f47c8067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47ec140580 0x7f47ec168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47ec1401b0 0x7f47ec0ab570 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 --2- 172.21.15.149:0/1562969794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47ec0b1270 0x7f47ec0a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.241+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 >> 172.21.15.149:0/1562969794 conn(0x7f47ec0cb9b0 msgr2=0x7f47ec06df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.242+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 shutdown_connections 2024-08-17T02:50:03.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.242+0000 7f47f1a00640 1 -- 172.21.15.149:0/1562969794 wait complete. 2024-08-17T02:50:03.258 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000066836 and related pools 2024-08-17T02:50:03.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:03.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.407+0000 7fd014c00640 1 Processor -- start 2024-08-17T02:50:03.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.407+0000 7fd014c00640 1 -- start start 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.408+0000 7fd014c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd010155df0 0x7fd0100adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.408+0000 7fd014c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd010156670 con 0x7fd01006df00 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.408+0000 7fd014c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01006e5e0 con 0x7fd010155a20 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.408+0000 7fd014c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0100b0350 con 0x7fd010155df0 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.408+0000 7fd00d400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd01006df00 0x7fd010156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54592/0 (socket says 172.21.15.149:54592) 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.408+0000 7fd00d400640 1 -- 172.21.15.149:0/1207513861 learned_addr learned my addr 172.21.15.149:0/1207513861 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.409+0000 7fd00e800640 1 --2- 172.21.15.149:0/1207513861 >> v2:172.21.15.161:3300/0 conn(0x7fd010155df0 0x7fd0100adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.409+0000 7fd00ca00640 1 -- 172.21.15.149:0/1207513861 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649382646 0 0) 0x7fd010156670 con 0x7fd01006df00 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.409+0000 7fd00ca00640 1 -- 172.21.15.149:0/1207513861 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff40034e0 con 0x7fd01006df00 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.409+0000 7fd00e800640 1 -- 172.21.15.149:0/1207513861 >> v1:172.21.15.161:6789/0 conn(0x7fd010155a20 legacy=0x7fd01006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.409+0000 7fd00e800640 1 -- 172.21.15.149:0/1207513861 >> v1:172.21.15.149:6789/0 conn(0x7fd01006df00 legacy=0x7fd010156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.409+0000 7fd00e800640 1 -- 172.21.15.149:0/1207513861 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01006e8c0 con 0x7fd010155df0 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.410+0000 7fd00e800640 1 --2- 172.21.15.149:0/1207513861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd0100adf10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd008009e60 tx=0x7fd008009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f0711a3f6135d11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.410+0000 7fd00ca00640 1 -- 172.21.15.149:0/1207513861 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008007550 con 0x7fd010155df0 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.410+0000 7fd00ca00640 1 -- 172.21.15.149:0/1207513861 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00802d050 con 0x7fd010155df0 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd00ca00640 1 -- 172.21.15.149:0/1207513861 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080078e0 con 0x7fd010155df0 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 -- 172.21.15.149:0/1207513861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 msgr2=0x7fd0100adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 --2- 172.21.15.149:0/1207513861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd0100adf10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd008009e60 tx=0x7fd008009780 comp rx=0 tx=0).stop 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 -- 172.21.15.149:0/1207513861 shutdown_connections 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 --2- 172.21.15.149:0/1207513861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd0100adf10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 -- 172.21.15.149:0/1207513861 >> 172.21.15.149:0/1207513861 conn(0x7fd0100cb9b0 msgr2=0x7fd0100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 -- 172.21.15.149:0/1207513861 shutdown_connections 2024-08-17T02:50:03.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.411+0000 7fd014c00640 1 -- 172.21.15.149:0/1207513861 wait complete. 2024-08-17T02:50:03.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.412+0000 7fd014c00640 1 Processor -- start 2024-08-17T02:50:03.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.413+0000 7fd014c00640 1 -- start start 2024-08-17T02:50:03.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.413+0000 7fd014c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd01006df00 0x7fd0100cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.413+0000 7fd014c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 0x7fd01015d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.413+0000 7fd014c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd01015d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.415 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.413+0000 7fd014c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100cb840 con 0x7fd010155a20 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd014c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd010168ff0 con 0x7fd010155df0 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd014c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0101692d0 con 0x7fd01006df00 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 0x7fd01015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 0x7fd01015d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55964/0 (socket says 172.21.15.149:55964) 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 -- 172.21.15.149:0/944507008 learned_addr learned my addr 172.21.15.149:0/944507008 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00e800640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd01015d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00de00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd01006df00 0x7fd0100cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 -- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd01006df00 msgr2=0x7fd0100cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd01006df00 0x7fd0100cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 -- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 msgr2=0x7fd01015d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd01015d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.414+0000 7fd00d400640 1 -- 172.21.15.149:0/944507008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008009a20 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.415+0000 7fd00d400640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 0x7fd01015d370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c560 tx=0x7fcffc007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.415+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc005aa0 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.415+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc005c00 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.415+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0070d0 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.415+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0101695b0 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.415+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd010169b70 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.416+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd010169dc0 con 0x7fd010155a20 2024-08-17T02:50:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.417+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcffc007500 con 0x7fd010155a20 2024-08-17T02:50:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.418+0000 7fd005600640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcff0065150 0x7fcff0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.418+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fcffc081aa0 con 0x7fd010155a20 2024-08-17T02:50:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.418+0000 7fd00de00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcff0065150 0x7fcff0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.418+0000 7fd00de00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcff0065150 0x7fcff0067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd000007fd0 tx=0x7fd000007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.422+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcffc04faf0 con 0x7fd010155a20 2024-08-17T02:50:03.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.631+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd010064db0 con 0x7fd010155a20 2024-08-17T02:50:03.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.631+0000 7fd005600640 1 -- 172.21.15.149:0/944507008 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4624 (secure 0 0 0) 0x7fcffc017020 con 0x7fd010155a20 2024-08-17T02:50:03.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:03.633 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1907492324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":1907492324},{"type":"v1","addr":"172.21.15.161:6835","nonce":1907492324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:03.633 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 23 2024-08-17T02:50:03.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcff0065150 msgr2=0x7fcff0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcff0065150 0x7fcff0067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd000007fd0 tx=0x7fd000007e30 comp rx=0 tx=0).stop 2024-08-17T02:50:03.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 msgr2=0x7fd01015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 0x7fd01015d370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c560 tx=0x7fcffc007d40 comp rx=0 tx=0).stop 2024-08-17T02:50:03.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 shutdown_connections 2024-08-17T02:50:03.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fcff0065150 0x7fcff0067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd010155df0 0x7fd01015d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd010155a20 0x7fd01015d370 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.633+0000 7fd014c00640 1 --2- 172.21.15.149:0/944507008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd01006df00 0x7fd0100cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.634+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 >> 172.21.15.149:0/944507008 conn(0x7fd0100cb9b0 msgr2=0x7fd0101524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:03.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.634+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 shutdown_connections 2024-08-17T02:50:03.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.634+0000 7fd014c00640 1 -- 172.21.15.149:0/944507008 wait complete. 2024-08-17T02:50:03.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:03.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.798+0000 7fc277000640 1 Processor -- start 2024-08-17T02:50:03.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.798+0000 7fc277000640 1 -- start start 2024-08-17T02:50:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.799+0000 7fc277000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc27006df00 0x7fc2700adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.799+0000 7fc277000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc270155df0 0x7fc2700ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.799+0000 7fc277000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc270156670 con 0x7fc270155a20 2024-08-17T02:50:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.799+0000 7fc277000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2700b0350 con 0x7fc270155df0 2024-08-17T02:50:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.799+0000 7fc277000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27006e5e0 con 0x7fc27006df00 2024-08-17T02:50:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc275000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc270155df0 0x7fc2700ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc26fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc270155a20 0x7fc27006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54598/0 (socket says 172.21.15.149:54598) 2024-08-17T02:50:03.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc26fe00640 1 -- 172.21.15.149:0/4225122261 learned_addr learned my addr 172.21.15.149:0/4225122261 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:03.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc26f400640 1 --2- 172.21.15.149:0/4225122261 >> v2:172.21.15.161:3300/0 conn(0x7fc27006df00 0x7fc2700adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc275000640 1 -- 172.21.15.149:0/4225122261 >> v2:172.21.15.161:3300/0 conn(0x7fc27006df00 msgr2=0x7fc2700adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc275000640 1 --2- 172.21.15.149:0/4225122261 >> v2:172.21.15.161:3300/0 conn(0x7fc27006df00 0x7fc2700adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc275000640 1 -- 172.21.15.149:0/4225122261 >> v1:172.21.15.149:6789/0 conn(0x7fc270155a20 legacy=0x7fc27006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc275000640 1 -- 172.21.15.149:0/4225122261 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27006e8c0 con 0x7fc270155df0 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.800+0000 7fc26ea00640 1 -- 172.21.15.149:0/4225122261 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364928373 0 0) 0x7fc270156670 con 0x7fc270155a20 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.801+0000 7fc275000640 1 --2- 172.21.15.149:0/4225122261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155df0 0x7fc2700ad9b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc27006aa40 tx=0x7fc268009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592e53397bfbdd32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.801+0000 7fc26ea00640 1 -- 172.21.15.149:0/4225122261 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268007550 con 0x7fc270155df0 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.801+0000 7fc26ea00640 1 -- 172.21.15.149:0/4225122261 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26802d050 con 0x7fc270155df0 2024-08-17T02:50:03.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc26ea00640 1 -- 172.21.15.149:0/4225122261 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680078e0 con 0x7fc270155df0 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 -- 172.21.15.149:0/4225122261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155df0 msgr2=0x7fc2700ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 --2- 172.21.15.149:0/4225122261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155df0 0x7fc2700ad9b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc27006aa40 tx=0x7fc268009780 comp rx=0 tx=0).stop 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 -- 172.21.15.149:0/4225122261 shutdown_connections 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 --2- 172.21.15.149:0/4225122261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155df0 0x7fc2700ad9b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 --2- 172.21.15.149:0/4225122261 >> v2:172.21.15.161:3300/0 conn(0x7fc27006df00 0x7fc2700adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 -- 172.21.15.149:0/4225122261 >> 172.21.15.149:0/4225122261 conn(0x7fc2700cb9b0 msgr2=0x7fc2700cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 -- 172.21.15.149:0/4225122261 shutdown_connections 2024-08-17T02:50:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.802+0000 7fc277000640 1 -- 172.21.15.149:0/4225122261 wait complete. 2024-08-17T02:50:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.804+0000 7fc277000640 1 Processor -- start 2024-08-17T02:50:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.804+0000 7fc277000640 1 -- start start 2024-08-17T02:50:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc277000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc27006df00 0x7fc270151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc277000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 0x7fc27015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc277000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc270155df0 0x7fc27015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc277000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700ad470 con 0x7fc270155a20 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc277000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700a78a0 con 0x7fc270155df0 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc277000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc270166750 con 0x7fc27006df00 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 0x7fc27015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 0x7fc27015b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55978/0 (socket says 172.21.15.149:55978) 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 -- 172.21.15.149:0/101092837 learned_addr learned my addr 172.21.15.149:0/101092837 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26fe00640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc27006df00 0x7fc270151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc275000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc270155df0 0x7fc27015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 -- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc27006df00 msgr2=0x7fc270151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc27006df00 0x7fc270151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 -- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc270155df0 msgr2=0x7fc27015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc270155df0 0x7fc27015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc26f400640 1 -- 172.21.15.149:0/101092837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009a20 con 0x7fc270155a20 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.805+0000 7fc275000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc270155df0 0x7fc27015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.806+0000 7fc26f400640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 0x7fc27015b560 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00ea20 tx=0x7fc25c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.806+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c009600 con 0x7fc270155a20 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.806+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c00ca10 con 0x7fc270155a20 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.806+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2700aceb0 con 0x7fc270155a20 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.806+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00cdd0 con 0x7fc270155a20 2024-08-17T02:50:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.806+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2700a7530 con 0x7fc270155a20 2024-08-17T02:50:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.807+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc270064db0 con 0x7fc270155a20 2024-08-17T02:50:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.808+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc25c013680 con 0x7fc270155a20 2024-08-17T02:50:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.808+0000 7fc267400640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc250065150 0x7fc250067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.809+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc25c082750 con 0x7fc270155a20 2024-08-17T02:50:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.809+0000 7fc26fe00640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc250065150 0x7fc250067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:03.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.809+0000 7fc26fe00640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc250065150 0x7fc250067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2600011e0 tx=0x7fc260007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:03.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:03.813+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc25c0507a0 con 0x7fc270155a20 2024-08-17T02:50:04.021 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.020+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc27006d530 con 0x7fc270155a20 2024-08-17T02:50:04.022 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.020+0000 7fc267400640 1 -- 172.21.15.149:0/101092837 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4624 (secure 0 0 0) 0x7fc25c053dc0 con 0x7fc270155a20 2024-08-17T02:50:04.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:04.022 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1907492324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":1907492324},{"type":"v1","addr":"172.21.15.161:6835","nonce":1907492324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.580985+0000","modified":"2024-08-17T02:47:52.584350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/159303001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":159303001},{"type":"v1","addr":"172.21.15.149:6837","nonce":159303001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000066836","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:04.022 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 23 2024-08-17T02:50:04.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.022+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc250065150 msgr2=0x7fc250067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.022+0000 7fc277000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc250065150 0x7fc250067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2600011e0 tx=0x7fc260007ca0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 msgr2=0x7fc27015b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.024 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 0x7fc27015b560 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00ea20 tx=0x7fc25c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 shutdown_connections 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc250065150 0x7fc250067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc270155df0 0x7fc27015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc270155a20 0x7fc27015b560 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 --2- 172.21.15.149:0/101092837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc27006df00 0x7fc270151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 >> 172.21.15.149:0/101092837 conn(0x7fc2700cb9b0 msgr2=0x7fc27006c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 shutdown_connections 2024-08-17T02:50:04.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.023+0000 7fc277000640 1 -- 172.21.15.149:0/101092837 wait complete. 2024-08-17T02:50:04.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:04.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.189+0000 7fc88da00640 1 Processor -- start 2024-08-17T02:50:04.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.189+0000 7fc88da00640 1 -- start start 2024-08-17T02:50:04.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.190+0000 7fc88da00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc888155a20 0x7fc8880adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.190+0000 7fc88da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc888155df0 0x7fc8880ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc88da00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc888156670 con 0x7fc88806d7f0 2024-08-17T02:50:04.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc88da00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880b0350 con 0x7fc888155df0 2024-08-17T02:50:04.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc88da00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88806e5e0 con 0x7fc888155a20 2024-08-17T02:50:04.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc888155df0 0x7fc8880ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc888155df0 0x7fc8880ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55980/0 (socket says 172.21.15.149:55980) 2024-08-17T02:50:04.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 -- 172.21.15.149:0/1903273497 learned_addr learned my addr 172.21.15.149:0/1903273497 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:04.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc886a00640 1 --2- 172.21.15.149:0/1903273497 >> v2:172.21.15.161:3300/0 conn(0x7fc888155a20 0x7fc8880adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 -- 172.21.15.149:0/1903273497 >> v2:172.21.15.161:3300/0 conn(0x7fc888155a20 msgr2=0x7fc8880adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:04.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 --2- 172.21.15.149:0/1903273497 >> v2:172.21.15.161:3300/0 conn(0x7fc888155a20 0x7fc8880adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 -- 172.21.15.149:0/1903273497 >> v1:172.21.15.161:6789/0 conn(0x7fc88806d7f0 legacy=0x7fc8880ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc87fe00640 1 -- 172.21.15.149:0/1903273497 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88806e8c0 con 0x7fc888155df0 2024-08-17T02:50:04.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.191+0000 7fc886a00640 1 --2- 172.21.15.149:0/1903273497 >> v2:172.21.15.161:3300/0 conn(0x7fc888155a20 0x7fc8880adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:04.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.192+0000 7fc87fe00640 1 --2- 172.21.15.149:0/1903273497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc8880ad9b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc88806bc00 tx=0x7fc8700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13f881b3f062d74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc886000640 1 -- 172.21.15.149:0/1903273497 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87002ae80 con 0x7fc888155df0 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc886000640 1 -- 172.21.15.149:0/1903273497 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc870032440 con 0x7fc888155df0 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc886000640 1 -- 172.21.15.149:0/1903273497 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870032800 con 0x7fc888155df0 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 -- 172.21.15.149:0/1903273497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 msgr2=0x7fc8880ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 --2- 172.21.15.149:0/1903273497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc8880ad9b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc88806bc00 tx=0x7fc8700091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 -- 172.21.15.149:0/1903273497 shutdown_connections 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 --2- 172.21.15.149:0/1903273497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc8880ad9b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 --2- 172.21.15.149:0/1903273497 >> v2:172.21.15.161:3300/0 conn(0x7fc888155a20 0x7fc8880adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 -- 172.21.15.149:0/1903273497 >> 172.21.15.149:0/1903273497 conn(0x7fc8880cb9b0 msgr2=0x7fc8880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:04.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 -- 172.21.15.149:0/1903273497 shutdown_connections 2024-08-17T02:50:04.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.193+0000 7fc88da00640 1 -- 172.21.15.149:0/1903273497 wait complete. 2024-08-17T02:50:04.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.195+0000 7fc88da00640 1 Processor -- start 2024-08-17T02:50:04.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.195+0000 7fc88da00640 1 -- start start 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc88da00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc88806d7f0 0x7fc8880c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc88da00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc888155a20 0x7fc8881441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc88da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc888144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc88da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88816a2d0 con 0x7fc888155df0 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc88da00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ace80 con 0x7fc888155a20 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc88da00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ad160 con 0x7fc88806d7f0 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc888144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc888144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55990/0 (socket says 172.21.15.149:55990) 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 -- 172.21.15.149:0/1367335818 learned_addr learned my addr 172.21.15.149:0/1367335818 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc87fe00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc888155a20 0x7fc8881441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc886a00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc88806d7f0 0x7fc8880c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 -- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc88806d7f0 msgr2=0x7fc8880c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc88806d7f0 0x7fc8880c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 -- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc888155a20 msgr2=0x7fc8881441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc888155a20 0x7fc8881441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.196+0000 7fc887400640 1 -- 172.21.15.149:0/1367335818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870009450 con 0x7fc888155df0 2024-08-17T02:50:04.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.197+0000 7fc887400640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc888144730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c860 tx=0x7fc880001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.197+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000ce50 con 0x7fc888155df0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.197+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000a850 con 0x7fc888155df0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.197+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000ac10 con 0x7fc888155df0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.197+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880ad440 con 0x7fc888155df0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.197+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8880c4870 con 0x7fc888155df0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.198+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888064db0 con 0x7fc888155df0 2024-08-17T02:50:04.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.199+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc880012630 con 0x7fc888155df0 2024-08-17T02:50:04.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.200+0000 7fc87e000640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc864065180 0x7fc864067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.200+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc880082680 con 0x7fc888155df0 2024-08-17T02:50:04.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.200+0000 7fc886a00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc864065180 0x7fc864067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.201+0000 7fc886a00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc864065180 0x7fc864067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc878006e70 tx=0x7fc878008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.204+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc8800506d0 con 0x7fc888155df0 2024-08-17T02:50:04.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.379+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc888152b20 con 0x7fc888155df0 2024-08-17T02:50:04.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.380+0000 7fc87e000640 1 -- 172.21.15.149:0/1367335818 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15560 (secure 0 0 0) 0x7fc880053cf0 con 0x7fc888155df0 2024-08-17T02:50:04.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:04.381 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:50:01.053457+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000066836.meta","create_time":"2024-08-17T02:47:48.713066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000066836"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000066836.data","create_time":"2024-08-17T02:47:49.612933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000066836"}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6835/807513628":"2024-08-18T02:49:58.035874+0000","172.21.15.161:6833/807513628":"2024-08-18T02:49:58.035874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc864065180 msgr2=0x7fc864067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc864065180 0x7fc864067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc878006e70 tx=0x7fc878008040 comp rx=0 tx=0).stop 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 msgr2=0x7fc888144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc888144730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c860 tx=0x7fc880001690 comp rx=0 tx=0).stop 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 shutdown_connections 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc864065180 0x7fc864067630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc888155df0 0x7fc888144730 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc888155a20 0x7fc8881441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 --2- 172.21.15.149:0/1367335818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc88806d7f0 0x7fc8880c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 >> 172.21.15.149:0/1367335818 conn(0x7fc8880cb9b0 msgr2=0x7fc888069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 shutdown_connections 2024-08-17T02:50:04.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.382+0000 7fc88da00640 1 -- 172.21.15.149:0/1367335818 wait complete. 2024-08-17T02:50:04.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000066836 2024-08-17T02:50:04.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.546+0000 7fc029400640 1 Processor -- start 2024-08-17T02:50:04.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.546+0000 7fc029400640 1 -- start start 2024-08-17T02:50:04.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.547+0000 7fc029400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0240b1440 0x7fc0240caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.547+0000 7fc029400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc024140580 0x7fc0240c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.547+0000 7fc029400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240caa80 con 0x7fc0241401b0 2024-08-17T02:50:04.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.547+0000 7fc029400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0240cb450 con 0x7fc024140580 2024-08-17T02:50:04.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.547+0000 7fc029400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c9e70 con 0x7fc0240b1440 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc021e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0240b1440 0x7fc0240caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc024140580 0x7fc0240c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc024140580 0x7fc0240c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:33952/0 (socket says 172.21.15.149:33952) 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 -- 172.21.15.149:0/2426979419 learned_addr learned my addr 172.21.15.149:0/2426979419 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc021e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0240b1440 0x7fc0240caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:45524/0 (socket says 172.21.15.149:45524) 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 -- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0240b1440 msgr2=0x7fc0240caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 --2- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0240b1440 0x7fc0240caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 -- 172.21.15.149:0/2426979419 >> v1:172.21.15.161:6789/0 conn(0x7fc0241401b0 legacy=0x7fc0240b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.548+0000 7fc023200640 1 -- 172.21.15.149:0/2426979419 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240ca150 con 0x7fc024140580 2024-08-17T02:50:04.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.549+0000 7fc023200640 1 --2- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c9040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009f20 tx=0x7fc01c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=633e25ddfd593a37 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.549+0000 7fc021400640 1 -- 172.21.15.149:0/2426979419 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c031400 con 0x7fc024140580 2024-08-17T02:50:04.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc021400640 1 -- 172.21.15.149:0/2426979419 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c02d050 con 0x7fc024140580 2024-08-17T02:50:04.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc021400640 1 -- 172.21.15.149:0/2426979419 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0317d0 con 0x7fc024140580 2024-08-17T02:50:04.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 -- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 msgr2=0x7fc0240c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 --2- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c9040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009f20 tx=0x7fc01c009840 comp rx=0 tx=0).stop 2024-08-17T02:50:04.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 -- 172.21.15.149:0/2426979419 shutdown_connections 2024-08-17T02:50:04.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 --2- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c9040 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 --2- 172.21.15.149:0/2426979419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0240b1440 0x7fc0240caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 -- 172.21.15.149:0/2426979419 >> 172.21.15.149:0/2426979419 conn(0x7fc0240cb9b0 msgr2=0x7fc0240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 -- 172.21.15.149:0/2426979419 shutdown_connections 2024-08-17T02:50:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.550+0000 7fc029400640 1 -- 172.21.15.149:0/2426979419 wait complete. 2024-08-17T02:50:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.552+0000 7fc029400640 1 Processor -- start 2024-08-17T02:50:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.552+0000 7fc029400640 1 -- start start 2024-08-17T02:50:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc029400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 0x7fc02412aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc029400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0241401b0 0x7fc0240ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc029400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc029400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c68d0 con 0x7fc0240b1440 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc029400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c5d00 con 0x7fc024140580 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc029400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c5fa0 con 0x7fc0241401b0 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 0x7fc02412aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 0x7fc02412aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56002/0 (socket says 172.21.15.149:56002) 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 -- 172.21.15.149:0/3264453715 learned_addr learned my addr 172.21.15.149:0/3264453715 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc023200640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc021e00640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0241401b0 0x7fc0240ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 -- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0241401b0 msgr2=0x7fc0240ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0241401b0 0x7fc0240ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 -- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 msgr2=0x7fc0240c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc022800640 1 -- 172.21.15.149:0/3264453715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c009ae0 con 0x7fc0240b1440 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc023200640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.553+0000 7fc021e00640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0241401b0 0x7fc0240ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.554+0000 7fc022800640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 0x7fc02412aad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c560 tx=0x7fc014007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.554+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014012630 con 0x7fc0240b1440 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.554+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0140127b0 con 0x7fc0240b1440 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.554+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014012b70 con 0x7fc0240b1440 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.554+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0240c6280 con 0x7fc0240b1440 2024-08-17T02:50:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.554+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02413cc00 con 0x7fc0240b1440 2024-08-17T02:50:04.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.555+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc024064db0 con 0x7fc0240b1440 2024-08-17T02:50:04.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.556+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc01401b400 con 0x7fc0240b1440 2024-08-17T02:50:04.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.557+0000 7fc01a000640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc004065150 0x7fc004067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.557+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc014082160 con 0x7fc0240b1440 2024-08-17T02:50:04.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.557+0000 7fc021e00640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc004065150 0x7fc004067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.558+0000 7fc021e00640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc004065150 0x7fc004067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc024169c40 tx=0x7fc010008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.560+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc014050100 con 0x7fc0240b1440 2024-08-17T02:50:04.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.769+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000066836"} v 0) v1 -- 0x7fc02413ce20 con 0x7fc0240b1440 2024-08-17T02:50:04.771 INFO:tasks.ceph.mon.a.smithi149.stderr:2024-08-17T02:50:04.770+0000 7fa0b9600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:50:04.779 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.774+0000 7fc01a000640 1 -- 172.21.15.149:0/3264453715 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000066836"}]=0 volume_0000000000066836 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 195+0+0 (secure 0 0 0) 0x7fc014053720 con 0x7fc0240b1440 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:volume_0000000000066836 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc004065150 msgr2=0x7fc004067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc004065150 0x7fc004067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc024169c40 tx=0x7fc010008040 comp rx=0 tx=0).stop 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 msgr2=0x7fc02412aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 0x7fc02412aad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c560 tx=0x7fc014007ef0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 shutdown_connections 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc004065150 0x7fc004067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc024140580 0x7fc0240c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0241401b0 0x7fc0240ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 --2- 172.21.15.149:0/3264453715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0240b1440 0x7fc02412aad0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 >> 172.21.15.149:0/3264453715 conn(0x7fc0240cb9b0 msgr2=0x7fc024159210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:04.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 shutdown_connections 2024-08-17T02:50:04.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.777+0000 7fc029400640 1 -- 172.21.15.149:0/3264453715 wait complete. 2024-08-17T02:50:04.782 INFO:tasks.ceph.mds.a.smithi149.stderr: -3082> 2024-08-17T02:47:57.343+0000 7f5299400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:50:04.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000066836 --yes-i-really-mean-it 2024-08-17T02:50:04.826 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2024-08-17T02:50:04.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.949+0000 7f86b0c00640 1 Processor -- start 2024-08-17T02:50:04.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.949+0000 7f86b0c00640 1 -- start start 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86b0c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86ac0af6b0 0x7f86ac06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86b0c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac06dcf0 0x7f86ac156c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86b0c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac156770 con 0x7f86ac0af2e0 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86b0c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0b1950 con 0x7f86ac0af6b0 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86b0c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac06e0e0 con 0x7f86ac06dcf0 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86a9e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f86ac0af2e0 0x7f86ac0b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54604/0 (socket says 172.21.15.149:54604) 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86a9e00640 1 -- 172.21.15.149:0/3546862646 learned_addr learned my addr 172.21.15.149:0/3546862646 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:04.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86aa800640 1 --2- 172.21.15.149:0/3546862646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac06dcf0 0x7f86ac156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86a3e00640 1 --2- 172.21.15.149:0/3546862646 >> v2:172.21.15.161:3300/0 conn(0x7f86ac0af6b0 0x7f86ac06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86a9400640 1 -- 172.21.15.149:0/3546862646 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075345192 0 0) 0x7f86ac156770 con 0x7f86ac0af2e0 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86a9400640 1 -- 172.21.15.149:0/3546862646 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86900034e0 con 0x7f86ac0af2e0 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86aa800640 1 -- 172.21.15.149:0/3546862646 >> v2:172.21.15.161:3300/0 conn(0x7f86ac0af6b0 msgr2=0x7f86ac06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.951+0000 7f86aa800640 1 --2- 172.21.15.149:0/3546862646 >> v2:172.21.15.161:3300/0 conn(0x7f86ac0af6b0 0x7f86ac06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.952+0000 7f86aa800640 1 -- 172.21.15.149:0/3546862646 >> v1:172.21.15.149:6789/0 conn(0x7f86ac0af2e0 legacy=0x7f86ac0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.952+0000 7f86aa800640 1 -- 172.21.15.149:0/3546862646 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac155b60 con 0x7f86ac06dcf0 2024-08-17T02:50:04.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86aa800640 1 --2- 172.21.15.149:0/3546862646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac06dcf0 0x7f86ac156c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009e60 tx=0x7f86a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c3a23bfe91c014b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86a9400640 1 -- 172.21.15.149:0/3546862646 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4007550 con 0x7f86ac06dcf0 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86a9400640 1 -- 172.21.15.149:0/3546862646 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a402d050 con 0x7f86ac06dcf0 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86a9400640 1 -- 172.21.15.149:0/3546862646 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4007900 con 0x7f86ac06dcf0 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86b0c00640 1 -- 172.21.15.149:0/3546862646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac06dcf0 msgr2=0x7f86ac156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86b0c00640 1 --2- 172.21.15.149:0/3546862646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac06dcf0 0x7f86ac156c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009e60 tx=0x7f86a4009780 comp rx=0 tx=0).stop 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86b0c00640 1 -- 172.21.15.149:0/3546862646 shutdown_connections 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86b0c00640 1 --2- 172.21.15.149:0/3546862646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac06dcf0 0x7f86ac156c00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86b0c00640 1 --2- 172.21.15.149:0/3546862646 >> v2:172.21.15.161:3300/0 conn(0x7f86ac0af6b0 0x7f86ac06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.953+0000 7f86b0c00640 1 -- 172.21.15.149:0/3546862646 >> 172.21.15.149:0/3546862646 conn(0x7f86ac067750 msgr2=0x7f86ac0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.954+0000 7f86b0c00640 1 -- 172.21.15.149:0/3546862646 shutdown_connections 2024-08-17T02:50:04.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.954+0000 7f86b0c00640 1 -- 172.21.15.149:0/3546862646 wait complete. 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.955+0000 7f86b0c00640 1 Processor -- start 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.955+0000 7f86b0c00640 1 -- start start 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86b0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 0x7f86ac0a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86b0c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac0af2e0 0x7f86ac0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86b0c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86ac0af6b0 0x7f86ac0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86b0c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0ab510 con 0x7f86ac06dcf0 2024-08-17T02:50:04.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86b0c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0aa470 con 0x7f86ac0af6b0 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86b0c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0aa750 con 0x7f86ac0af2e0 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 0x7f86ac0a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 0x7f86ac0a9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56038/0 (socket says 172.21.15.149:56038) 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 -- 172.21.15.149:0/2411883608 learned_addr learned my addr 172.21.15.149:0/2411883608 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a3e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac0af2e0 0x7f86ac0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86aa800640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86ac0af6b0 0x7f86ac0ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 -- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac0af2e0 msgr2=0x7f86ac0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac0af2e0 0x7f86ac0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 -- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86ac0af6b0 msgr2=0x7f86ac0ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86ac0af6b0 0x7f86ac0ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a9e00640 1 -- 172.21.15.149:0/2411883608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4009a20 con 0x7f86ac06dcf0 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.956+0000 7f86a3e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac0af2e0 0x7f86ac0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.957+0000 7f86a9e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 0x7f86ac0a9940 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f869c00c560 tx=0x7f869c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.957+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c005aa0 con 0x7f86ac06dcf0 2024-08-17T02:50:04.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.957+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c005c00 con 0x7f86ac06dcf0 2024-08-17T02:50:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.957+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0070d0 con 0x7f86ac06dcf0 2024-08-17T02:50:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.957+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac0aaa30 con 0x7f86ac06dcf0 2024-08-17T02:50:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.957+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac0aaff0 con 0x7f86ac06dcf0 2024-08-17T02:50:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.958+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac0ab210 con 0x7f86ac06dcf0 2024-08-17T02:50:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.959+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f869c0074c0 con 0x7f86ac06dcf0 2024-08-17T02:50:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.960+0000 7f86a1600640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8688065150 0x7f8688067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.960+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f869c081ac0 con 0x7f86ac06dcf0 2024-08-17T02:50:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.960+0000 7f86a3e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8688065150 0x7f8688067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.961+0000 7f86a3e00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8688065150 0x7f8688067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0a88f0 tx=0x7f8694008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:04.964 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:04.963+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f869c04fa00 con 0x7f86ac06dcf0 2024-08-17T02:50:05.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.171+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000066836", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86ac0aa1c0 con 0x7f86ac06dcf0 2024-08-17T02:50:05.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.776+0000 7f86a1600640 1 -- 172.21.15.149:0/2411883608 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000066836", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7f869c053020 con 0x7f86ac06dcf0 2024-08-17T02:50:05.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.778+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8688065150 msgr2=0x7f8688067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.778+0000 7f86b0c00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8688065150 0x7f8688067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0a88f0 tx=0x7f8694008040 comp rx=0 tx=0).stop 2024-08-17T02:50:05.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.778+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 msgr2=0x7f86ac0a9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.778+0000 7f86b0c00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 0x7f86ac0a9940 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f869c00c560 tx=0x7f869c007d60 comp rx=0 tx=0).stop 2024-08-17T02:50:05.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.778+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 shutdown_connections 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8688065150 0x7f8688067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86ac0af6b0 0x7f86ac0ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86ac0af2e0 0x7f86ac0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 --2- 172.21.15.149:0/2411883608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ac06dcf0 0x7f86ac0a9940 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 >> 172.21.15.149:0/2411883608 conn(0x7f86ac067750 msgr2=0x7f86ac154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 shutdown_connections 2024-08-17T02:50:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.779+0000 7f86b0c00640 1 -- 172.21.15.149:0/2411883608 wait complete. 2024-08-17T02:50:05.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000066836.meta cephfs.volume_0000000000066836.meta --yes-i-really-really-mean-it 2024-08-17T02:50:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.989+0000 7f302d200640 1 Processor -- start 2024-08-17T02:50:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.989+0000 7f302d200640 1 -- start start 2024-08-17T02:50:05.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f302d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f30280b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f302d200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30280b5740 0x7f302815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f302d200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280d0a80 con 0x7f302815c2e0 2024-08-17T02:50:05.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f302d200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280b2130 con 0x7f30280b5740 2024-08-17T02:50:05.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f302d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302815c720 con 0x7f30280b2bb0 2024-08-17T02:50:05.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f3027e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f302815c2e0 0x7f30280b0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:54618/0 (socket says 172.21.15.149:54618) 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.990+0000 7f3027e00640 1 -- 172.21.15.149:0/3846146844 learned_addr learned my addr 172.21.15.149:0/3846146844 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3027400640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f30280b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026a00640 1 --2- 172.21.15.149:0/3846146844 >> v2:172.21.15.161:3300/0 conn(0x7f30280b5740 0x7f302815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884354780 0 0) 0x7f30280d0a80 con 0x7f302815c2e0 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f300c0034e0 con 0x7f302815c2e0 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224384571 0 0) 0x7f300c0034e0 con 0x7f302815c2e0 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 msgr2=0x7f30280b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f30280b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 >> v2:172.21.15.161:3300/0 conn(0x7f30280b5740 msgr2=0x7f302815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 --2- 172.21.15.149:0/3846146844 >> v2:172.21.15.161:3300/0 conn(0x7f30280b5740 0x7f302815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280b23f0 con 0x7f302815c2e0 2024-08-17T02:50:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f30200017f0 con 0x7f302815c2e0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026a00640 1 --2- 172.21.15.149:0/3846146844 >> v2:172.21.15.161:3300/0 conn(0x7f30280b5740 0x7f302815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3027400640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f30280b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 >> v1:172.21.15.149:6789/0 conn(0x7f302815c2e0 legacy=0x7f30280b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c0039d0 0x7f300c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f300c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f300c004cc0 0x7f300c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280b2130 con 0x7f300c004cc0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302815c720 con 0x7f300c0039d0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.991+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c00b9d0 con 0x7f30280b2bb0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027e00640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f300c004cc0 0x7f300c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3026a00640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f300c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027400640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c0039d0 0x7f300c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027e00640 1 -- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 msgr2=0x7f300c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027e00640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280b2bb0 0x7f300c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027e00640 1 -- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c0039d0 msgr2=0x7f300c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027e00640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c0039d0 0x7f300c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.992+0000 7f3027e00640 1 -- 172.21.15.149:0/3846146844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009390 con 0x7f300c004cc0 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.993+0000 7f3027e00640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f300c004cc0 0x7f300c005130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f302000a970 tx=0x7f3020002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae614a11b1091d9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.993+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302002c510 con 0x7f300c004cc0 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.993+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302002c6b0 con 0x7f300c004cc0 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.993+0000 7f3026000640 1 -- 172.21.15.149:0/3846146844 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302002cab0 con 0x7f300c004cc0 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f302d200640 1 -- 172.21.15.149:0/3846146844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f300c004cc0 msgr2=0x7f300c005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f302d200640 1 --2- 172.21.15.149:0/3846146844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f300c004cc0 0x7f300c005130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f302000a970 tx=0x7f3020002210 comp rx=0 tx=0).stop 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f3027e00640 1 -- 172.21.15.149:0/3846146844 reap_dead start 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f302d200640 1 -- 172.21.15.149:0/3846146844 shutdown_connections 2024-08-17T02:50:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f302d200640 1 -- 172.21.15.149:0/3846146844 >> 172.21.15.149:0/3846146844 conn(0x7f30280cfbc0 msgr2=0x7f30280cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f302d200640 1 -- 172.21.15.149:0/3846146844 shutdown_connections 2024-08-17T02:50:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.994+0000 7f302d200640 1 -- 172.21.15.149:0/3846146844 wait complete. 2024-08-17T02:50:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.995+0000 7f302d200640 1 Processor -- start 2024-08-17T02:50:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.996+0000 7f302d200640 1 -- start start 2024-08-17T02:50:05.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.996+0000 7f302d200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c004cc0 0x7f30280ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.996+0000 7f302d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280abd40 0x7f3028158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.996+0000 7f302d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 0x7f302809ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f302d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280aeee0 con 0x7f30281696c0 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f302d200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028158f80 con 0x7f300c004cc0 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f302d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30280ac290 con 0x7f30280abd40 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 0x7f302809ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 0x7f302809ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56060/0 (socket says 172.21.15.149:56060) 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 -- 172.21.15.149:0/2534771691 learned_addr learned my addr 172.21.15.149:0/2534771691 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3026a00640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280abd40 0x7f3028158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027400640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c004cc0 0x7f30280ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 -- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280abd40 msgr2=0x7f3028158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280abd40 0x7f3028158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 -- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c004cc0 msgr2=0x7f30280ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c004cc0 0x7f30280ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 -- 172.21.15.149:0/2534771691 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280ac570 con 0x7f30281696c0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.997+0000 7f3027e00640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 0x7f302809ba20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f302000a970 tx=0x7f3020034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.998+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020038070 con 0x7f30281696c0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.998+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302002c510 con 0x7f30281696c0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.998+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30200017b0 con 0x7f30281696c0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.998+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30280ac850 con 0x7f30281696c0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.998+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30280ace10 con 0x7f30281696c0 2024-08-17T02:50:06.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:05.999+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30280ad000 con 0x7f30281696c0 2024-08-17T02:50:06.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.000+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3020007710 con 0x7f30281696c0 2024-08-17T02:50:06.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.001+0000 7f301ea00640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3008065200 0x7f30080676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.001+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f302003b040 con 0x7f30281696c0 2024-08-17T02:50:06.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.001+0000 7f3027400640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3008065200 0x7f30080676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.002+0000 7f3027400640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3008065200 0x7f30080676b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3018006e70 tx=0x7f30180090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.006+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f30200701d0 con 0x7f30281696c0 2024-08-17T02:50:06.181 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:06.180+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000066836.meta", "pool2": "cephfs.volume_0000000000066836.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3028071050 con 0x7f30281696c0 2024-08-17T02:50:07.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.092+0000 7f301ea00640 1 -- 172.21.15.149:0/2534771691 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000066836.meta", "pool2": "cephfs.volume_0000000000066836.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000066836.meta' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7f30200737f0 con 0x7f30281696c0 2024-08-17T02:50:07.094 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs.volume_0000000000066836.meta' removed 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3008065200 msgr2=0x7f30080676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3008065200 0x7f30080676b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3018006e70 tx=0x7f30180090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 msgr2=0x7f302809ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 0x7f302809ba20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f302000a970 tx=0x7f3020034000 comp rx=0 tx=0).stop 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 shutdown_connections 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f3008065200 0x7f30080676b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30281696c0 0x7f302809ba20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30280abd40 0x7f3028158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 --2- 172.21.15.149:0/2534771691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f300c004cc0 0x7f30280ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.096+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 >> 172.21.15.149:0/2534771691 conn(0x7f30280cfbc0 msgr2=0x7f30280afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.097+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 shutdown_connections 2024-08-17T02:50:07.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.097+0000 7f302d200640 1 -- 172.21.15.149:0/2534771691 wait complete. 2024-08-17T02:50:07.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000066836.data cephfs.volume_0000000000066836.data --yes-i-really-really-mean-it 2024-08-17T02:50:07.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.271+0000 7ff72ee00640 1 Processor -- start 2024-08-17T02:50:07.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.271+0000 7ff72ee00640 1 -- start start 2024-08-17T02:50:07.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.272+0000 7ff72ee00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff728156890 0x7ff72806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.272+0000 7ff72ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7280c8840 0x7ff72806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.272+0000 7ff72ee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7280ae9b0 con 0x7ff728156c60 2024-08-17T02:50:07.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.272+0000 7ff72ee00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7280aa730 con 0x7ff728156890 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.272+0000 7ff72ee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280aa9f0 con 0x7ff7280c8840 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.272+0000 7ff727e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff728156890 0x7ff72806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff727e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff728156890 0x7ff72806dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34726/0 (socket says 172.21.15.149:34726) 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff727e00640 1 -- 172.21.15.149:0/1918436880 learned_addr learned my addr 172.21.15.149:0/1918436880 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff72ce00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7280c8840 0x7ff72806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff727e00640 1 -- 172.21.15.149:0/1918436880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7280c8840 msgr2=0x7ff72806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff727e00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7280c8840 0x7ff72806e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff727e00640 1 -- 172.21.15.149:0/1918436880 >> v1:172.21.15.149:6789/0 conn(0x7ff728156c60 legacy=0x7ff7280c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff727e00640 1 -- 172.21.15.149:0/1918436880 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280ab320 con 0x7ff728156890 2024-08-17T02:50:07.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.273+0000 7ff72ce00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7280c8840 0x7ff72806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:07.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.274+0000 7ff727e00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728156890 0x7ff72806dee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff718009910 tx=0x7ff7180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656951d735545d6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.274+0000 7ff726a00640 1 -- 172.21.15.149:0/1918436880 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71802add0 con 0x7ff728156890 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.274+0000 7ff726a00640 1 -- 172.21.15.149:0/1918436880 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff718032440 con 0x7ff728156890 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.274+0000 7ff726a00640 1 -- 172.21.15.149:0/1918436880 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718032820 con 0x7ff728156890 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 -- 172.21.15.149:0/1918436880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728156890 msgr2=0x7ff72806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728156890 0x7ff72806dee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff718009910 tx=0x7ff7180091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 -- 172.21.15.149:0/1918436880 shutdown_connections 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7280c8840 0x7ff72806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 --2- 172.21.15.149:0/1918436880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728156890 0x7ff72806dee0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 -- 172.21.15.149:0/1918436880 >> 172.21.15.149:0/1918436880 conn(0x7ff728067750 msgr2=0x7ff72806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 -- 172.21.15.149:0/1918436880 shutdown_connections 2024-08-17T02:50:07.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.275+0000 7ff72ee00640 1 -- 172.21.15.149:0/1918436880 wait complete. 2024-08-17T02:50:07.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.276+0000 7ff72ee00640 1 Processor -- start 2024-08-17T02:50:07.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.276+0000 7ff72ee00640 1 -- start start 2024-08-17T02:50:07.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.277+0000 7ff72ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 0x7ff7281517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.277+0000 7ff72ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff728156890 0x7ff72816cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.277+0000 7ff72ee00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff728156c60 0x7ff728150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.277+0000 7ff72ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72814fdc0 con 0x7ff7280c8840 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.277+0000 7ff72ee00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72814fac0 con 0x7ff728156c60 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.277+0000 7ff72ee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72816d420 con 0x7ff728156890 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 0x7ff7281517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 0x7ff7281517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34732/0 (socket says 172.21.15.149:34732) 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 -- 172.21.15.149:0/621916345 learned_addr learned my addr 172.21.15.149:0/621916345 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727400640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff728156890 0x7ff72816cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff72ce00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff728156c60 0x7ff728150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 -- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff728156890 msgr2=0x7ff72816cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff728156890 0x7ff72816cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 -- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff728156c60 msgr2=0x7ff728150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff728156c60 0x7ff728150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 -- 172.21.15.149:0/621916345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718009450 con 0x7ff7280c8840 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff72ce00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff728156c60 0x7ff728150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.278+0000 7ff727e00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 0x7ff7281517d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff718009970 tx=0x7ff718032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.279+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718000c90 con 0x7ff7280c8840 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.279+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff718031a40 con 0x7ff7280c8840 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.279+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718031e00 con 0x7ff7280c8840 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.279+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72816d700 con 0x7ff7280c8840 2024-08-17T02:50:07.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.279+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff728150790 con 0x7ff7280c8840 2024-08-17T02:50:07.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.280+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7280710c0 con 0x7ff7280c8840 2024-08-17T02:50:07.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.280+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff718039040 con 0x7ff7280c8840 2024-08-17T02:50:07.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.282+0000 7ff71f400640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff708065150 0x7ff708067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.282+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5448+0+0 (secure 0 0 0) 0x7ff7180a1ff0 con 0x7ff7280c8840 2024-08-17T02:50:07.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.282+0000 7ff727400640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff708065150 0x7ff708067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.283+0000 7ff727400640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff708065150 0x7ff708067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff728068c10 tx=0x7ff714009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.286+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff718070170 con 0x7ff7280c8840 2024-08-17T02:50:07.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:07.458+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000066836.data", "pool2": "cephfs.volume_0000000000066836.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7280ae220 con 0x7ff7280c8840 2024-08-17T02:50:08.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.100+0000 7ff71f400640 1 -- 172.21.15.149:0/621916345 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000066836.data", "pool2": "cephfs.volume_0000000000066836.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000066836.data' removed v45) v1 ==== 241+0+0 (secure 0 0 0) 0x7ff718073790 con 0x7ff7280c8840 2024-08-17T02:50:08.102 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs.volume_0000000000066836.data' removed 2024-08-17T02:50:08.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff708065150 msgr2=0x7ff708067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff708065150 0x7ff708067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff728068c10 tx=0x7ff714009040 comp rx=0 tx=0).stop 2024-08-17T02:50:08.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 msgr2=0x7ff7281517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 0x7ff7281517d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff718009970 tx=0x7ff718032000 comp rx=0 tx=0).stop 2024-08-17T02:50:08.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 shutdown_connections 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7ff708065150 0x7ff708067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff728156c60 0x7ff728150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff728156890 0x7ff72816cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 --2- 172.21.15.149:0/621916345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280c8840 0x7ff7281517d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 >> 172.21.15.149:0/621916345 conn(0x7ff728067750 msgr2=0x7ff7280c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 shutdown_connections 2024-08-17T02:50:08.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.103+0000 7ff72ee00640 1 -- 172.21.15.149:0/621916345 wait complete. 2024-08-17T02:50:08.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:50:08.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.271+0000 7f44ada00640 1 Processor -- start 2024-08-17T02:50:08.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.271+0000 7f44ada00640 1 -- start start 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44ada00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44a8155980 0x7f44a8156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44ada00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44ada00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44a80af580 0x7f44a80afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44ada00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a80aff40 con 0x7f44a8155980 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44ada00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a8158400 con 0x7f44a80af580 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44ada00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a81577f0 con 0x7f44a80a54d0 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44a8155980 0x7f44a8156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44a8155980 0x7f44a8156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34738/0 (socket says 172.21.15.149:34738) 2024-08-17T02:50:08.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 -- 172.21.15.149:0/3271569005 learned_addr learned my addr 172.21.15.149:0/3271569005 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a7400640 1 --2- 172.21.15.149:0/3271569005 >> v2:172.21.15.161:3300/0 conn(0x7f44a80af580 0x7f44a80afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f449e000640 1 --2- 172.21.15.149:0/3271569005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 -- 172.21.15.149:0/3271569005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 msgr2=0x7f44a8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3271569005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a8155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 -- 172.21.15.149:0/3271569005 >> v2:172.21.15.161:3300/0 conn(0x7f44a80af580 msgr2=0x7f44a80afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3271569005 >> v2:172.21.15.161:3300/0 conn(0x7f44a80af580 0x7f44a80afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.273+0000 7f44a6a00640 1 -- 172.21.15.149:0/3271569005 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a8157ad0 con 0x7f44a8155980 2024-08-17T02:50:08.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.274+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3271569005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a8155980 0x7f44a8156f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f44a806c550 tx=0x7f44980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857a41eca5156852 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44a6000640 1 -- 172.21.15.149:0/3271569005 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449802add0 con 0x7f44a8155980 2024-08-17T02:50:08.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44a6000640 1 -- 172.21.15.149:0/3271569005 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4498032440 con 0x7f44a8155980 2024-08-17T02:50:08.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44a6000640 1 -- 172.21.15.149:0/3271569005 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498032820 con 0x7f44a8155980 2024-08-17T02:50:08.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 -- 172.21.15.149:0/3271569005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a8155980 msgr2=0x7f44a8156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 --2- 172.21.15.149:0/3271569005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a8155980 0x7f44a8156f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f44a806c550 tx=0x7f44980091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 -- 172.21.15.149:0/3271569005 shutdown_connections 2024-08-17T02:50:08.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 --2- 172.21.15.149:0/3271569005 >> v2:172.21.15.161:3300/0 conn(0x7f44a80af580 0x7f44a80afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 --2- 172.21.15.149:0/3271569005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a8155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 --2- 172.21.15.149:0/3271569005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a8155980 0x7f44a8156f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 -- 172.21.15.149:0/3271569005 >> 172.21.15.149:0/3271569005 conn(0x7f44a8067750 msgr2=0x7f44a80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.275+0000 7f44ada00640 1 -- 172.21.15.149:0/3271569005 shutdown_connections 2024-08-17T02:50:08.279 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.276+0000 7f44ada00640 1 -- 172.21.15.149:0/3271569005 wait complete. 2024-08-17T02:50:08.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.277+0000 7f44ada00640 1 Processor -- start 2024-08-17T02:50:08.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.277+0000 7f44ada00640 1 -- start start 2024-08-17T02:50:08.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f44ada00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a814bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f44ada00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 0x7f44a814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f44ada00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44a8155980 0x7f44a814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f44ada00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a814d2d0 con 0x7f44a80af580 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f44ada00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a814c6c0 con 0x7f44a8155980 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f44ada00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a814c9a0 con 0x7f44a80a54d0 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f449e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 0x7f44a814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f449e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 0x7f44a814e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34750/0 (socket says 172.21.15.149:34750) 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.278+0000 7f449e000640 1 -- 172.21.15.149:0/3902132451 learned_addr learned my addr 172.21.15.149:0/3902132451 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a814bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449e000640 1 -- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 msgr2=0x7f44a814bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449e000640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a814bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f44a7400640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44a8155980 0x7f44a814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449e000640 1 -- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44a8155980 msgr2=0x7f44a814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449e000640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44a8155980 0x7f44a814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449e000640 1 -- 172.21.15.149:0/3902132451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009450 con 0x7f44a80af580 2024-08-17T02:50:08.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a814bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449e000640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 0x7f44a814e020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f449000d890 tx=0x7f4490008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000de20 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000b8d0 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a814cc80 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000bc70 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.279+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a8169290 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.281+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a80ae190 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.281+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4490014640 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.282+0000 7f449ea00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4484065150 0x7f4484067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.283+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4490082800 con 0x7f44a80af580 2024-08-17T02:50:08.286 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.283+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4484065150 0x7f4484067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.283+0000 7f44a6a00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4484065150 0x7f4484067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4498034000 tx=0x7f4498032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.287+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f44a80ae190 con 0x7f44a80af580 2024-08-17T02:50:08.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.458+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f44a80ae190 con 0x7f44a80af580 2024-08-17T02:50:08.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.462+0000 7f449ea00640 1 -- 172.21.15.149:0/3902132451 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f44a80ae190 con 0x7f44a80af580 2024-08-17T02:50:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.464+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4484065150 msgr2=0x7f4484067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.464+0000 7f44ada00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4484065150 0x7f4484067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4498034000 tx=0x7f4498032000 comp rx=0 tx=0).stop 2024-08-17T02:50:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.464+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 msgr2=0x7f44a814e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.464+0000 7f44ada00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 0x7f44a814e020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f449000d890 tx=0x7f4490008040 comp rx=0 tx=0).stop 2024-08-17T02:50:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 shutdown_connections 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4484065150 0x7f4484067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44a8155980 0x7f44a814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a80af580 0x7f44a814e020 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 --2- 172.21.15.149:0/3902132451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44a80a54d0 0x7f44a814bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 >> 172.21.15.149:0/3902132451 conn(0x7f44a8067750 msgr2=0x7f44a8151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 shutdown_connections 2024-08-17T02:50:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.465+0000 7f44ada00640 1 -- 172.21.15.149:0/3902132451 wait complete. 2024-08-17T02:50:08.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:50:08.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.631+0000 7fb054c00640 1 Processor -- start 2024-08-17T02:50:08.633 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.631+0000 7fb054c00640 1 -- start start 2024-08-17T02:50:08.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.632+0000 7fb054c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0500ceb40 0x7fb0500cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb054c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0500ccf30 con 0x7fb0500ccad0 2024-08-17T02:50:08.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb054c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0500cadc0 con 0x7fb050159ca0 2024-08-17T02:50:08.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb054c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500cd6e0 con 0x7fb0500ceb40 2024-08-17T02:50:08.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb04fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb0500ccad0 0x7fb050162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33370/0 (socket says 172.21.15.149:33370) 2024-08-17T02:50:08.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb04fe00640 1 -- 172.21.15.149:0/987634374 learned_addr learned my addr 172.21.15.149:0/987634374 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:08.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb04ea00640 1 --2- 172.21.15.149:0/987634374 >> v2:172.21.15.161:3300/0 conn(0x7fb0500ceb40 0x7fb0500cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220203305 0 0) 0x7fb0500ccf30 con 0x7fb0500ccad0 2024-08-17T02:50:08.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.633+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0340034e0 con 0x7fb0500ccad0 2024-08-17T02:50:08.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578114677 0 0) 0x7fb0500cadc0 con 0x7fb050159ca0 2024-08-17T02:50:08.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0500ccf30 con 0x7fb050159ca0 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442260281 0 0) 0x7fb0340034e0 con 0x7fb0500ccad0 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 >> v2:172.21.15.161:3300/0 conn(0x7fb0500ceb40 msgr2=0x7fb0500cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 --2- 172.21.15.149:0/987634374 >> v2:172.21.15.161:3300/0 conn(0x7fb0500ceb40 0x7fb0500cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 >> v1:172.21.15.161:6789/0 conn(0x7fb050159ca0 legacy=0x7fb0500ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500cb060 con 0x7fb0500ccad0 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7fb048001810 con 0x7fb0500ccad0 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 >> v1:172.21.15.149:6789/0 conn(0x7fb0500ccad0 legacy=0x7fb050162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb034003bb0 0x7fb034003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb034004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb034005180 0x7fb03400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500cd6e0 con 0x7fb034004780 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400c0a0 con 0x7fb034005180 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400c230 con 0x7fb034003bb0 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04ea00640 1 --2- 172.21.15.149:0/987634374 >> v2:172.21.15.161:3300/0 conn(0x7fb0500ceb40 0x7fb0500cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04ea00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb034004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04f400640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb034003bb0 0x7fb034003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.634+0000 7fb04fe00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb034005180 0x7fb03400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.635+0000 7fb04ea00640 1 -- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb034003bb0 msgr2=0x7fb034003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.635+0000 7fb04ea00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb034003bb0 0x7fb034003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.635+0000 7fb04ea00640 1 -- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb034005180 msgr2=0x7fb03400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.635+0000 7fb04ea00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb034005180 0x7fb03400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.635+0000 7fb04ea00640 1 -- 172.21.15.149:0/987634374 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340034e0 con 0x7fb034004780 2024-08-17T02:50:08.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.635+0000 7fb04fe00640 1 -- 172.21.15.149:0/987634374 reap_dead start 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb04ea00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb034004bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009d50 tx=0x7fb03c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5147da8343c0115 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c031400 con 0x7fb034004780 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c02d050 con 0x7fb034004780 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb04e000640 1 -- 172.21.15.149:0/987634374 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c031790 con 0x7fb034004780 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb054c00640 1 -- 172.21.15.149:0/987634374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 msgr2=0x7fb034004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb054c00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb034004bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009d50 tx=0x7fb03c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb054c00640 1 -- 172.21.15.149:0/987634374 shutdown_connections 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb054c00640 1 --2- 172.21.15.149:0/987634374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb034004bf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb054c00640 1 -- 172.21.15.149:0/987634374 >> 172.21.15.149:0/987634374 conn(0x7fb050098e00 msgr2=0x7fb05006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.636+0000 7fb054c00640 1 -- 172.21.15.149:0/987634374 shutdown_connections 2024-08-17T02:50:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.637+0000 7fb054c00640 1 -- 172.21.15.149:0/987634374 wait complete. 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.638+0000 7fb054c00640 1 Processor -- start 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.638+0000 7fb054c00640 1 -- start start 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb054c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb050152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb054c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0500c5e60 0x7fb0500cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb054c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0500d0170 0x7fb0500b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb054c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05016d0f0 con 0x7fb034004780 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb054c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500d05c0 con 0x7fb0500d0170 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb054c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05016c4e0 con 0x7fb0500c5e60 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb04f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb050152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb04f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb050152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34770/0 (socket says 172.21.15.149:34770) 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb04f400640 1 -- 172.21.15.149:0/3958946271 learned_addr learned my addr 172.21.15.149:0/3958946271 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb04ea00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0500c5e60 0x7fb0500cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.639+0000 7fb04fe00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0500d0170 0x7fb0500b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb04f400640 1 -- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0500c5e60 msgr2=0x7fb0500cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb04f400640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0500c5e60 0x7fb0500cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb04f400640 1 -- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0500d0170 msgr2=0x7fb0500b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb04f400640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0500d0170 0x7fb0500b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb04f400640 1 -- 172.21.15.149:0/3958946271 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05016c7c0 con 0x7fb034004780 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb04f400640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb050152940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb040002a80 tx=0x7fb040007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040007260 con 0x7fb034004780 2024-08-17T02:50:08.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0400073c0 con 0x7fb034004780 2024-08-17T02:50:08.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040006790 con 0x7fb034004780 2024-08-17T02:50:08.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05016caa0 con 0x7fb034004780 2024-08-17T02:50:08.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.640+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb050152e80 con 0x7fb034004780 2024-08-17T02:50:08.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.642+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050071050 con 0x7fb034004780 2024-08-17T02:50:08.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.642+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb040006b80 con 0x7fb034004780 2024-08-17T02:50:08.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.643+0000 7fb046a00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb030065150 0x7fb030067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.643+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb040082040 con 0x7fb034004780 2024-08-17T02:50:08.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.644+0000 7fb04ea00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb030065150 0x7fb030067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.644+0000 7fb04ea00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb030065150 0x7fb030067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb03c034000 tx=0x7fb03c035000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.648 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.647+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb0400503a0 con 0x7fb034004780 2024-08-17T02:50:08.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:08.880+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fb0500691b0 con 0x7fb034004780 2024-08-17T02:50:09.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.101+0000 7fb046a00640 1 -- 172.21.15.149:0/3958946271 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v164) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb0400539c0 con 0x7fb034004780 2024-08-17T02:50:09.104 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb030065150 msgr2=0x7fb030067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb030065150 0x7fb030067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb03c034000 tx=0x7fb03c035000 comp rx=0 tx=0).stop 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 msgr2=0x7fb050152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb050152940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb040002a80 tx=0x7fb040007ca0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 shutdown_connections 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fb030065150 0x7fb030067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0500d0170 0x7fb0500b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0500c5e60 0x7fb0500cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 --2- 172.21.15.149:0/3958946271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb034004780 0x7fb050152940 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 >> 172.21.15.149:0/3958946271 conn(0x7fb050098e00 msgr2=0x7fb050155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 shutdown_connections 2024-08-17T02:50:09.105 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:09.103+0000 7fb054c00640 1 -- 172.21.15.149:0/3958946271 wait complete. 2024-08-17T02:50:09.123 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:50:09.124 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000066836 --yes-i-really-mean-it' 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:50:09.125 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.442s 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:50:09.126 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000066836 --yes-i-really-mean-it' 2024-08-17T02:50:09.127 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:09.127 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:09.354 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0e12c1b2d0e74befbea2be0b093b6ecf Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:09.356 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:50:09.363 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:50:09.380 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:50:09.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:09.381 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:50:09.420 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:50:09.420 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:50:09.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:09.421 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:50:09.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:09.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:50:09.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:09.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-08-17T02:50:10.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.100 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-08-17T02:50:10.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-08-17T02:50:10.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:10.184 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:10.238 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-08-17T02:50:10.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:10.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.241 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:50:10.278 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:50:10.279 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:50:10.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:50:10.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:50:10.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.644 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-08-17T02:50:10.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:10.970 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-08-17T02:50:11.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:11.006 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-08-17T02:50:11.106 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-08-17T02:50:11.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:11.109 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:50:11.118 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:50:11.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:11.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.269+0000 7efd01e00640 1 Processor -- start 2024-08-17T02:50:11.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.269+0000 7efd01e00640 1 -- start start 2024-08-17T02:50:11.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.270+0000 7efd01e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc0aea20 0x7efcfc0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.270+0000 7efd01e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcfc155180 0x7efcfc0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efd01e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc0afc10 con 0x7efcfc1555d0 2024-08-17T02:50:11.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efd01e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcfc0aedf0 con 0x7efcfc155180 2024-08-17T02:50:11.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efd01e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0ae5b0 con 0x7efcfc0aea20 2024-08-17T02:50:11.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfb400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7efcfc1555d0 0x7efcfc0ad0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33382/0 (socket says 172.21.15.149:33382) 2024-08-17T02:50:11.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfb400640 1 -- 172.21.15.149:0/2787023607 learned_addr learned my addr 172.21.15.149:0/2787023607 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:11.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfa000640 1 --2- 172.21.15.149:0/2787023607 >> v2:172.21.15.161:3300/0 conn(0x7efcfc155180 0x7efcfc0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfaa00640 1 --2- 172.21.15.149:0/2787023607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc0aea20 0x7efcfc0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcf9600640 1 -- 172.21.15.149:0/2787023607 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732574938 0 0) 0x7efcfc0afc10 con 0x7efcfc1555d0 2024-08-17T02:50:11.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcf9600640 1 -- 172.21.15.149:0/2787023607 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce00034e0 con 0x7efcfc1555d0 2024-08-17T02:50:11.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfaa00640 1 -- 172.21.15.149:0/2787023607 >> v2:172.21.15.161:3300/0 conn(0x7efcfc155180 msgr2=0x7efcfc0acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfaa00640 1 --2- 172.21.15.149:0/2787023607 >> v2:172.21.15.161:3300/0 conn(0x7efcfc155180 0x7efcfc0acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfaa00640 1 -- 172.21.15.149:0/2787023607 >> v1:172.21.15.149:6789/0 conn(0x7efcfc1555d0 legacy=0x7efcfc0ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfaa00640 1 -- 172.21.15.149:0/2787023607 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0af000 con 0x7efcfc0aea20 2024-08-17T02:50:11.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.271+0000 7efcfa000640 1 --2- 172.21.15.149:0/2787023607 >> v2:172.21.15.161:3300/0 conn(0x7efcfc155180 0x7efcfc0acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:11.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efcfaa00640 1 --2- 172.21.15.149:0/2787023607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc0aea20 0x7efcfc0ae070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcec009850 tx=0x7efcec0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d736d2624384a538 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efcf9600640 1 -- 172.21.15.149:0/2787023607 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec02ad80 con 0x7efcfc0aea20 2024-08-17T02:50:11.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efcf9600640 1 -- 172.21.15.149:0/2787023607 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec032440 con 0x7efcfc0aea20 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efcf9600640 1 -- 172.21.15.149:0/2787023607 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec032820 con 0x7efcfc0aea20 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 -- 172.21.15.149:0/2787023607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc0aea20 msgr2=0x7efcfc0ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 --2- 172.21.15.149:0/2787023607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc0aea20 0x7efcfc0ae070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcec009850 tx=0x7efcec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 -- 172.21.15.149:0/2787023607 shutdown_connections 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 --2- 172.21.15.149:0/2787023607 >> v2:172.21.15.161:3300/0 conn(0x7efcfc155180 0x7efcfc0acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 --2- 172.21.15.149:0/2787023607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc0aea20 0x7efcfc0ae070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 -- 172.21.15.149:0/2787023607 >> 172.21.15.149:0/2787023607 conn(0x7efcfc0cb9b0 msgr2=0x7efcfc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 -- 172.21.15.149:0/2787023607 shutdown_connections 2024-08-17T02:50:11.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.273+0000 7efd01e00640 1 -- 172.21.15.149:0/2787023607 wait complete. 2024-08-17T02:50:11.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.275+0000 7efd01e00640 1 Processor -- start 2024-08-17T02:50:11.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.275+0000 7efd01e00640 1 -- start start 2024-08-17T02:50:11.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efd01e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 0x7efcfc0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efd01e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc155180 0x7efcfc151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.280 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efd01e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcfc1555d0 0x7efcfc16a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efd01e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc157b90 con 0x7efcfc0aea20 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efd01e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc156f80 con 0x7efcfc1555d0 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efd01e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc157260 con 0x7efcfc155180 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 0x7efcfc0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 0x7efcfc0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34774/0 (socket says 172.21.15.149:34774) 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efcfaa00640 1 -- 172.21.15.149:0/3194502373 learned_addr learned my addr 172.21.15.149:0/3194502373 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.276+0000 7efcfa000640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc155180 0x7efcfc151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.281 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfaa00640 1 -- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc155180 msgr2=0x7efcfc151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfb400640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcfc1555d0 0x7efcfc16a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfaa00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc155180 0x7efcfc151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfaa00640 1 -- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcfc1555d0 msgr2=0x7efcfc16a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfaa00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcfc1555d0 0x7efcfc16a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfaa00640 1 -- 172.21.15.149:0/3194502373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8009390 con 0x7efcfc0aea20 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfb400640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcfc1555d0 0x7efcfc16a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcfaa00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 0x7efcfc0c19e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efcec009360 tx=0x7efcec032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec031c20 con 0x7efcfc0aea20 2024-08-17T02:50:11.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec031da0 con 0x7efcfc0aea20 2024-08-17T02:50:11.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec009390 con 0x7efcfc0aea20 2024-08-17T02:50:11.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec03d670 con 0x7efcfc0aea20 2024-08-17T02:50:11.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.277+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc157820 con 0x7efcfc0aea20 2024-08-17T02:50:11.283 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.279+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc064db0 con 0x7efcfc0aea20 2024-08-17T02:50:11.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.279+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efcec039040 con 0x7efcfc0aea20 2024-08-17T02:50:11.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.280+0000 7efcf2000640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcdc065150 0x7efcdc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.280+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efcec0a2340 con 0x7efcfc0aea20 2024-08-17T02:50:11.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.280+0000 7efcfa000640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcdc065150 0x7efcdc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.281+0000 7efcfa000640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcdc065150 0x7efcdc067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efce8009360 tx=0x7efce8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.285 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.284+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efcec0706a0 con 0x7efcfc0aea20 2024-08-17T02:50:11.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.457+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcfc06e7b0 con 0x7efcfc0aea20 2024-08-17T02:50:11.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.458+0000 7efcf2000640 1 -- 172.21.15.149:0/3194502373 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12441 (secure 0 0 0) 0x7efcec073cc0 con 0x7efcfc0aea20 2024-08-17T02:50:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:11.460 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":45,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:50:08.093073+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6837/159303001":"2024-08-18T02:50:04.771577+0000","172.21.15.149:6835/159303001":"2024-08-18T02:50:04.771577+0000","172.21.15.161:6835/807513628":"2024-08-18T02:49:58.035874+0000","172.21.15.161:6833/807513628":"2024-08-18T02:49:58.035874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:11.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcdc065150 msgr2=0x7efcdc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcdc065150 0x7efcdc067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efce8009360 tx=0x7efce8008040 comp rx=0 tx=0).stop 2024-08-17T02:50:11.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 msgr2=0x7efcfc0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 0x7efcfc0c19e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efcec009360 tx=0x7efcec032000 comp rx=0 tx=0).stop 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 shutdown_connections 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7efcdc065150 0x7efcdc067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcfc1555d0 0x7efcfc16a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcfc155180 0x7efcfc151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 --2- 172.21.15.149:0/3194502373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcfc0aea20 0x7efcfc0c19e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 >> 172.21.15.149:0/3194502373 conn(0x7efcfc0cb9b0 msgr2=0x7efcfc0cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 shutdown_connections 2024-08-17T02:50:11.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.460+0000 7efd01e00640 1 -- 172.21.15.149:0/3194502373 wait complete. 2024-08-17T02:50:11.477 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:50:11.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:11.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.625+0000 7f5fa3a00640 1 Processor -- start 2024-08-17T02:50:11.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.625+0000 7f5fa3a00640 1 -- start start 2024-08-17T02:50:11.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.626+0000 7f5fa3a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 0x7f5f9c0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.626+0000 7f5fa3a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f9c0ac820 0x7f5f9c159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.626+0000 7f5fa3a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c0abc80 con 0x7f5f9c0aa910 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.626+0000 7f5fa3a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c0ab070 con 0x7f5f9c0ac820 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.626+0000 7f5fa3a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0ab350 con 0x7f5f9c158cb0 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 0x7f5f9c0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 0x7f5f9c0af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.149:49866/0 (socket says 172.21.15.149:49866) 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 -- 172.21.15.149:0/1459291612 learned_addr learned my addr 172.21.15.149:0/1459291612 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1a00640 1 --2- 172.21.15.149:0/1459291612 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c0ac820 0x7f5f9c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 -- 172.21.15.149:0/1459291612 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c0ac820 msgr2=0x7f5f9c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 --2- 172.21.15.149:0/1459291612 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c0ac820 0x7f5f9c159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 -- 172.21.15.149:0/1459291612 >> v1:172.21.15.161:6789/0 conn(0x7f5f9c0aa910 legacy=0x7f5f9c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.627+0000 7f5fa1000640 1 -- 172.21.15.149:0/1459291612 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0ab630 con 0x7f5f9c158cb0 2024-08-17T02:50:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.628+0000 7f5fa1000640 1 --2- 172.21.15.149:0/1459291612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 0x7f5f9c0af6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009910 tx=0x7f5f900091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b34f02f6c35e0584 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.628+0000 7f5f9b400640 1 -- 172.21.15.149:0/1459291612 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9002ae40 con 0x7f5f9c158cb0 2024-08-17T02:50:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.628+0000 7f5f9b400640 1 -- 172.21.15.149:0/1459291612 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f90032440 con 0x7f5f9c158cb0 2024-08-17T02:50:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.628+0000 7f5f9b400640 1 -- 172.21.15.149:0/1459291612 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90032820 con 0x7f5f9c158cb0 2024-08-17T02:50:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 -- 172.21.15.149:0/1459291612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 msgr2=0x7f5f9c0af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/1459291612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 0x7f5f9c0af6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009910 tx=0x7f5f900091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 -- 172.21.15.149:0/1459291612 shutdown_connections 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/1459291612 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c0ac820 0x7f5f9c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/1459291612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c158cb0 0x7f5f9c0af6d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 -- 172.21.15.149:0/1459291612 >> 172.21.15.149:0/1459291612 conn(0x7f5f9c096a70 msgr2=0x7f5f9c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 -- 172.21.15.149:0/1459291612 shutdown_connections 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.629+0000 7f5fa3a00640 1 -- 172.21.15.149:0/1459291612 wait complete. 2024-08-17T02:50:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.630+0000 7f5fa3a00640 1 Processor -- start 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 -- start start 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c0aa910 0x7f5f9c169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c0ac820 0x7f5f9c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 0x7f5f9c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0cd540 con 0x7f5f9c158cb0 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0b1e90 con 0x7f5f9c0ac820 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.631+0000 7f5fa3a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0b2cb0 con 0x7f5f9c0aa910 2024-08-17T02:50:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 0x7f5f9c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 0x7f5f9c0b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34778/0 (socket says 172.21.15.149:34778) 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 -- 172.21.15.149:0/751857375 learned_addr learned my addr 172.21.15.149:0/751857375 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1000640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c0aa910 0x7f5f9c169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5f9be00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c0ac820 0x7f5f9c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 -- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c0aa910 msgr2=0x7f5f9c169ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c0aa910 0x7f5f9c169ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 -- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c0ac820 msgr2=0x7f5f9c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c0ac820 0x7f5f9c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.632+0000 7f5fa1a00640 1 -- 172.21.15.149:0/751857375 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90009450 con 0x7f5f9c158cb0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.633+0000 7f5fa1a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 0x7f5f9c0b1950 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009e90 tx=0x7f5f9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.633+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400ce10 con 0x7f5f9c158cb0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.633+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400f040 con 0x7f5f9c158cb0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.633+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940146d0 con 0x7f5f9c158cb0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.633+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c0b20a0 con 0x7f5f9c158cb0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.633+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c0b2660 con 0x7f5f9c158cb0 2024-08-17T02:50:11.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.634+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c156ab0 con 0x7f5f9c158cb0 2024-08-17T02:50:11.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.635+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5f94014a80 con 0x7f5f9c158cb0 2024-08-17T02:50:11.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.636+0000 7f5f8fe00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5f7c065150 0x7f5f7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.636+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5f94082f80 con 0x7f5f9c158cb0 2024-08-17T02:50:11.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.636+0000 7f5fa1000640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5f7c065150 0x7f5f7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.637+0000 7f5fa1000640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5f7c065150 0x7f5f7c067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f90034000 tx=0x7f5f90032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.640+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5f9c156ab0 con 0x7f5f9c158cb0 2024-08-17T02:50:11.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.811+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f9c156ab0 con 0x7f5f7c065150 2024-08-17T02:50:11.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.814+0000 7f5f8fe00640 1 -- 172.21.15.149:0/751857375 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50671 (secure 0 0 0) 0x7f5f9c156ab0 con 0x7f5f7c065150 2024-08-17T02:50:11.816 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:11.816 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:50:11.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5f7c065150 msgr2=0x7f5f7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5f7c065150 0x7f5f7c067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f90034000 tx=0x7f5f90032000 comp rx=0 tx=0).stop 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 msgr2=0x7f5f9c0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 0x7f5f9c0b1950 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009e90 tx=0x7f5f9400b040 comp rx=0 tx=0).stop 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 shutdown_connections 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5f7c065150 0x7f5f7c067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f9c158cb0 0x7f5f9c0b1950 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c0ac820 0x7f5f9c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 --2- 172.21.15.149:0/751857375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c0aa910 0x7f5f9c169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 >> 172.21.15.149:0/751857375 conn(0x7f5f9c096a70 msgr2=0x7f5f9c154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 shutdown_connections 2024-08-17T02:50:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.816+0000 7f5fa3a00640 1 -- 172.21.15.149:0/751857375 wait complete. 2024-08-17T02:50:11.832 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:50:11.679300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388316,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586404,"statfs":{"total":773094113280,"available":770648477696,"internally_reserved":0,"allocated":5414912,"data_stored":2941208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.905096"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:50:07.828986+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:50:07.828986+0000","last_peered":"2024-08-17T02:50:07.828986+0000","last_clean":"2024-08-17T02:50:07.828986+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:50:07.828986+0000","last_undegraded":"2024-08-17T02:50:07.828986+0000","last_fullsized":"2024-08-17T02:50:07.828986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298456,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073384,"statfs":{"total":96636764160,"available":96331145216,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":2.722,"15min":2.722},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":2.23,"15min":2.23},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.86399999999999999,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94199999999999995,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92000000000000004,"5min":2.472,"15min":2.472},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":1.423,"15min":1.423},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.876}]},{"osd":6,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":1.492,"15min":1.492},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.72299999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.48699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.68999999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.443,"15min":0.443},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.044,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.58199999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95499999999999996,"5min":1.095,"15min":1.095},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.472,"15min":1.472},"last":0.97999999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94899999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.61899999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81999999999999995,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":3.552,"15min":3.552},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83999999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94299999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67600000000000005,"5min":1.103,"15min":1.103},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":1.333,"15min":1.333},"last":0.75800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91600000000000004,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97399999999999998,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.56999999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.498,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.077,"15min":1.077},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.129,"15min":1.129},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.016,"15min":1.016},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90600000000000003,"5min":1.363,"15min":1.363},"last":0.92100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.82699999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55600000000000005,"5min":3.6120000000000001,"15min":3.6120000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83999999999999997,"5min":1.516,"15min":1.516},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65700000000000003,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70299999999999996,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":2.456,"15min":2.456},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1000000000000001,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0980000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.84299999999999997,"15min":0.86799999999999999},"min":{"1min":0.58299999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.02,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.627,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0820000000000001,"5min":1.718,"15min":1.718},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.163,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.649,"15min":2.649},"last":1.018},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.131,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.96299999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.175,"15min":1.175},"last":0.436},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":1.347,"15min":1.347},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67200000000000004,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85599999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.58399999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93899999999999995,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.623},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97999999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.88400000000000001,"15min":0.95899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0720000000000001,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.70699999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.96799999999999997},"min":{"1min":0.58299999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.143,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90000000000000002,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.006,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.70399999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.52400000000000002,"15min":0.57599999999999996},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53300000000000003,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.60899999999999999,"15min":0.67900000000000005},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.58999999999999997,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":2.274,"15min":2.274},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":3.653,"15min":3.653},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.502}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97799999999999998,"5min":1.284,"15min":1.284},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.90800000000000003,"15min":0.96399999999999997},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.86299999999999999,"15min":0.92100000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.96799999999999997,"15min":1.0660000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76900000000000002,"15min":0.74299999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.92200000000000004,"15min":0.97799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0940000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.755}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.1459999999999999,"15min":1.298},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0720000000000001,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.121,"15min":1.256},"min":{"1min":0.66800000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0549999999999999,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.74099999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":2.137,"15min":2.137},"last":0.504}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.503,"15min":0.497},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":1.516,"15min":1.516},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.63400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1040000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.88},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.071,"5min":1.603,"15min":1.603},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.99099999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.68500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0049999999999999,"5min":1.649,"15min":1.649},"last":0.80500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.675,"15min":1.675},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:11.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:11.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.981+0000 7faa56000640 1 Processor -- start 2024-08-17T02:50:11.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.981+0000 7faa56000640 1 -- start start 2024-08-17T02:50:11.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.982+0000 7faa56000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faa50155a20 0x7faa500adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.982+0000 7faa56000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa50155df0 0x7faa500ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa56000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa50156670 con 0x7faa5006d7f0 2024-08-17T02:50:11.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa56000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500b0350 con 0x7faa50155df0 2024-08-17T02:50:11.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa56000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5006e5e0 con 0x7faa50155a20 2024-08-17T02:50:11.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa50155df0 0x7faa500ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa50155df0 0x7faa500ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34794/0 (socket says 172.21.15.149:34794) 2024-08-17T02:50:11.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa4fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faa5006d7f0 0x7faa500ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33384/0 (socket says 172.21.15.149:33384) 2024-08-17T02:50:11.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 -- 172.21.15.149:0/263067695 learned_addr learned my addr 172.21.15.149:0/263067695 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:11.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa4f400640 1 --2- 172.21.15.149:0/263067695 >> v2:172.21.15.161:3300/0 conn(0x7faa50155a20 0x7faa500adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 -- 172.21.15.149:0/263067695 >> v2:172.21.15.161:3300/0 conn(0x7faa50155a20 msgr2=0x7faa500adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 --2- 172.21.15.149:0/263067695 >> v2:172.21.15.161:3300/0 conn(0x7faa50155a20 0x7faa500adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 -- 172.21.15.149:0/263067695 >> v1:172.21.15.149:6789/0 conn(0x7faa5006d7f0 legacy=0x7faa500ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.983+0000 7faa47e00640 1 -- 172.21.15.149:0/263067695 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5006e8c0 con 0x7faa50155df0 2024-08-17T02:50:11.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.984+0000 7faa47e00640 1 --2- 172.21.15.149:0/263067695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500ad9b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faa5006bc00 tx=0x7faa380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e2b11332248551 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.984+0000 7faa4ea00640 1 -- 172.21.15.149:0/263067695 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3802ae80 con 0x7faa50155df0 2024-08-17T02:50:11.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa4ea00640 1 -- 172.21.15.149:0/263067695 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38032440 con 0x7faa50155df0 2024-08-17T02:50:11.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa4ea00640 1 -- 172.21.15.149:0/263067695 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38032800 con 0x7faa50155df0 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 -- 172.21.15.149:0/263067695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 msgr2=0x7faa500ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 --2- 172.21.15.149:0/263067695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500ad9b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faa5006bc00 tx=0x7faa380091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 -- 172.21.15.149:0/263067695 shutdown_connections 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 --2- 172.21.15.149:0/263067695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500ad9b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 --2- 172.21.15.149:0/263067695 >> v2:172.21.15.161:3300/0 conn(0x7faa50155a20 0x7faa500adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 -- 172.21.15.149:0/263067695 >> 172.21.15.149:0/263067695 conn(0x7faa500cb9b0 msgr2=0x7faa500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 -- 172.21.15.149:0/263067695 shutdown_connections 2024-08-17T02:50:11.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.985+0000 7faa56000640 1 -- 172.21.15.149:0/263067695 wait complete. 2024-08-17T02:50:11.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.987+0000 7faa56000640 1 Processor -- start 2024-08-17T02:50:11.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.987+0000 7faa56000640 1 -- start start 2024-08-17T02:50:11.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa56000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa5006d7f0 0x7faa5015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa56000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa50155a20 0x7faa5014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa56000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa56000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5015c1e0 con 0x7faa50155df0 2024-08-17T02:50:11.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa56000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5015c4a0 con 0x7faa5006d7f0 2024-08-17T02:50:11.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa56000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa50159ec0 con 0x7faa50155a20 2024-08-17T02:50:11.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa5006d7f0 0x7faa5015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa5006d7f0 0x7faa5015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.149:34936/0 (socket says 172.21.15.149:34936) 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4f400640 1 -- 172.21.15.149:0/4092991736 learned_addr learned my addr 172.21.15.149:0/4092991736 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa47e00640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa50155a20 0x7faa5014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4fe00640 1 -- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa50155a20 msgr2=0x7faa5014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4fe00640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa50155a20 0x7faa5014b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4fe00640 1 -- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa5006d7f0 msgr2=0x7faa5015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4fe00640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa5006d7f0 0x7faa5015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.988+0000 7faa4fe00640 1 -- 172.21.15.149:0/4092991736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009450 con 0x7faa50155df0 2024-08-17T02:50:11.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.989+0000 7faa4fe00640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500a54d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c7c0 tx=0x7faa480015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.989+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48004b20 con 0x7faa50155df0 2024-08-17T02:50:11.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.989+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48004ca0 con 0x7faa50155df0 2024-08-17T02:50:11.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.989+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800a890 con 0x7faa50155df0 2024-08-17T02:50:11.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.989+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5015a1a0 con 0x7faa50155df0 2024-08-17T02:50:11.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.989+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50160c50 con 0x7faa50155df0 2024-08-17T02:50:11.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.990+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50064db0 con 0x7faa50155df0 2024-08-17T02:50:11.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.991+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faa4800acc0 con 0x7faa50155df0 2024-08-17T02:50:11.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.992+0000 7faa46a00640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7faa2c065150 0x7faa2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.992+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7faa48081860 con 0x7faa50155df0 2024-08-17T02:50:11.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.992+0000 7faa4f400640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7faa2c065150 0x7faa2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.993+0000 7faa4f400640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7faa2c065150 0x7faa2c067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa40007c60 tx=0x7faa40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:11.996+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faa4804fc50 con 0x7faa50155df0 2024-08-17T02:50:12.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.170+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa501532b0 con 0x7faa2c065150 2024-08-17T02:50:12.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.172+0000 7faa46a00640 1 -- 172.21.15.149:0/4092991736 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50671 (secure 0 0 0) 0x7faa501532b0 con 0x7faa2c065150 2024-08-17T02:50:12.174 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:12.174 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:50:12.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7faa2c065150 msgr2=0x7faa2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7faa2c065150 0x7faa2c067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa40007c60 tx=0x7faa40008040 comp rx=0 tx=0).stop 2024-08-17T02:50:12.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 msgr2=0x7faa500a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500a54d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c7c0 tx=0x7faa480015e0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 shutdown_connections 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7faa2c065150 0x7faa2c067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa50155df0 0x7faa500a54d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa50155a20 0x7faa5014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 --2- 172.21.15.149:0/4092991736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa5006d7f0 0x7faa5015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 >> 172.21.15.149:0/4092991736 conn(0x7faa500cb9b0 msgr2=0x7faa50068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.174+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 shutdown_connections 2024-08-17T02:50:12.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.175+0000 7faa56000640 1 -- 172.21.15.149:0/4092991736 wait complete. 2024-08-17T02:50:12.191 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:50:11.679300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388316,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586404,"statfs":{"total":773094113280,"available":770648477696,"internally_reserved":0,"allocated":5414912,"data_stored":2941208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.905096"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:50:07.828986+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:50:07.828986+0000","last_peered":"2024-08-17T02:50:07.828986+0000","last_clean":"2024-08-17T02:50:07.828986+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:50:07.828986+0000","last_undegraded":"2024-08-17T02:50:07.828986+0000","last_fullsized":"2024-08-17T02:50:07.828986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298456,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073384,"statfs":{"total":96636764160,"available":96331145216,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":2.722,"15min":2.722},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":2.23,"15min":2.23},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.86399999999999999,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94199999999999995,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92000000000000004,"5min":2.472,"15min":2.472},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":1.423,"15min":1.423},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.876}]},{"osd":6,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":1.492,"15min":1.492},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.72299999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.48699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.68999999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.443,"15min":0.443},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.044,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.58199999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95499999999999996,"5min":1.095,"15min":1.095},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.472,"15min":1.472},"last":0.97999999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94899999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.61899999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81999999999999995,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":3.552,"15min":3.552},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83999999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94299999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67600000000000005,"5min":1.103,"15min":1.103},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":1.333,"15min":1.333},"last":0.75800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91600000000000004,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97399999999999998,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.56999999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.498,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.077,"15min":1.077},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.129,"15min":1.129},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.016,"15min":1.016},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90600000000000003,"5min":1.363,"15min":1.363},"last":0.92100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.82699999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55600000000000005,"5min":3.6120000000000001,"15min":3.6120000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83999999999999997,"5min":1.516,"15min":1.516},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65700000000000003,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70299999999999996,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":2.456,"15min":2.456},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1000000000000001,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0980000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.84299999999999997,"15min":0.86799999999999999},"min":{"1min":0.58299999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.02,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.627,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0820000000000001,"5min":1.718,"15min":1.718},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.163,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.649,"15min":2.649},"last":1.018},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.131,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.96299999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.175,"15min":1.175},"last":0.436},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":1.347,"15min":1.347},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67200000000000004,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85599999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.58399999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93899999999999995,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.623},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97999999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.88400000000000001,"15min":0.95899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0720000000000001,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.70699999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.96799999999999997},"min":{"1min":0.58299999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.143,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90000000000000002,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.006,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.70399999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.52400000000000002,"15min":0.57599999999999996},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53300000000000003,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.60899999999999999,"15min":0.67900000000000005},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.58999999999999997,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":2.274,"15min":2.274},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":3.653,"15min":3.653},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.502}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97799999999999998,"5min":1.284,"15min":1.284},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.90800000000000003,"15min":0.96399999999999997},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.86299999999999999,"15min":0.92100000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.96799999999999997,"15min":1.0660000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76900000000000002,"15min":0.74299999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.92200000000000004,"15min":0.97799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0940000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.755}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.1459999999999999,"15min":1.298},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0720000000000001,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.121,"15min":1.256},"min":{"1min":0.66800000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0549999999999999,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.74099999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":2.137,"15min":2.137},"last":0.504}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.503,"15min":0.497},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":1.516,"15min":1.516},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.63400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1040000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.88},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.071,"5min":1.603,"15min":1.603},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.99099999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.68500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0049999999999999,"5min":1.649,"15min":1.649},"last":0.80500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.675,"15min":1.675},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:12.192 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:50:12.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:12.341 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.340+0000 7fc768a00640 1 Processor -- start 2024-08-17T02:50:12.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.340+0000 7fc768a00640 1 -- start start 2024-08-17T02:50:12.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.341+0000 7fc768a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc76406df00 0x7fc7640adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.341+0000 7fc768a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc764156670 con 0x7fc764155a20 2024-08-17T02:50:12.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.341+0000 7fc768a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76406e5e0 con 0x7fc764155df0 2024-08-17T02:50:12.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.341+0000 7fc768a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640b0350 con 0x7fc76406df00 2024-08-17T02:50:12.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.341+0000 7fc761e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc764155a20 0x7fc76406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33398/0 (socket says 172.21.15.149:33398) 2024-08-17T02:50:12.344 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.341+0000 7fc761e00640 1 -- 172.21.15.149:0/233229627 learned_addr learned my addr 172.21.15.149:0/233229627 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:12.344 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc761400640 1 --2- 172.21.15.149:0/233229627 >> v2:172.21.15.161:3300/0 conn(0x7fc76406df00 0x7fc7640adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793757008 0 0) 0x7fc764156670 con 0x7fc764155a20 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480034e0 con 0x7fc764155a20 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315610691 0 0) 0x7fc76406e5e0 con 0x7fc764155df0 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc764156670 con 0x7fc764155df0 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc761400640 1 -- 172.21.15.149:0/233229627 >> v1:172.21.15.161:6789/0 conn(0x7fc764155df0 legacy=0x7fc764156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc761400640 1 -- 172.21.15.149:0/233229627 >> v1:172.21.15.149:6789/0 conn(0x7fc764155a20 legacy=0x7fc76406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.342+0000 7fc761400640 1 -- 172.21.15.149:0/233229627 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76406e8c0 con 0x7fc76406df00 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.343+0000 7fc761400640 1 --2- 172.21.15.149:0/233229627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc7640adf10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc750009850 tx=0x7fc7500090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140e80e3b8264422 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75002ad90 con 0x7fc76406df00 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750032440 con 0x7fc76406df00 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc760a00640 1 -- 172.21.15.149:0/233229627 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7500327e0 con 0x7fc76406df00 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 -- 172.21.15.149:0/233229627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 msgr2=0x7fc7640adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 --2- 172.21.15.149:0/233229627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc7640adf10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc750009850 tx=0x7fc7500090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.347 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 -- 172.21.15.149:0/233229627 shutdown_connections 2024-08-17T02:50:12.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 --2- 172.21.15.149:0/233229627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc7640adf10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 -- 172.21.15.149:0/233229627 >> 172.21.15.149:0/233229627 conn(0x7fc7640cb9b0 msgr2=0x7fc7640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 -- 172.21.15.149:0/233229627 shutdown_connections 2024-08-17T02:50:12.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.344+0000 7fc768a00640 1 -- 172.21.15.149:0/233229627 wait complete. 2024-08-17T02:50:12.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.346+0000 7fc768a00640 1 Processor -- start 2024-08-17T02:50:12.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.346+0000 7fc768a00640 1 -- start start 2024-08-17T02:50:12.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc768a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc76414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc768a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc764155a20 0x7fc7641690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc768a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 0x7fc764069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc768a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640a9e90 con 0x7fc764155df0 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc768a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640aa170 con 0x7fc76406df00 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc768a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640aa450 con 0x7fc764155a20 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 0x7fc764069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 0x7fc764069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34814/0 (socket says 172.21.15.149:34814) 2024-08-17T02:50:12.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 -- 172.21.15.149:0/1571503415 learned_addr learned my addr 172.21.15.149:0/1571503415 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc761e00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc76414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc761400640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc764155a20 0x7fc7641690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 -- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc764155a20 msgr2=0x7fc7641690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc764155a20 0x7fc7641690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 -- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 msgr2=0x7fc76414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc76414a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.347+0000 7fc762800640 1 -- 172.21.15.149:0/1571503415 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750009390 con 0x7fc764155df0 2024-08-17T02:50:12.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.348+0000 7fc762800640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 0x7fc764069970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c810 tx=0x7fc75c002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.348+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00a640 con 0x7fc764155df0 2024-08-17T02:50:12.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.348+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00a7a0 con 0x7fc764155df0 2024-08-17T02:50:12.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.348+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00ab40 con 0x7fc764155df0 2024-08-17T02:50:12.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.348+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7640aa730 con 0x7fc764155df0 2024-08-17T02:50:12.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.348+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76414a8a0 con 0x7fc764155df0 2024-08-17T02:50:12.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.349+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7640aac30 con 0x7fc764155df0 2024-08-17T02:50:12.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.350+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc75c012420 con 0x7fc764155df0 2024-08-17T02:50:12.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.351+0000 7fc759600640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc744065150 0x7fc744067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.351+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc75c0823d0 con 0x7fc764155df0 2024-08-17T02:50:12.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.351+0000 7fc761e00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc744065150 0x7fc744067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.352+0000 7fc761e00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc744065150 0x7fc744067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc754005840 tx=0x7fc754009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.355+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc75c0507e0 con 0x7fc764155df0 2024-08-17T02:50:12.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.522+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc764064db0 con 0x7fc744065150 2024-08-17T02:50:12.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.524+0000 7fc759600640 1 -- 172.21.15.149:0/1571503415 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50671 (secure 0 0 0) 0x7fc764064db0 con 0x7fc744065150 2024-08-17T02:50:12.526 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:12.526 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:50:12.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc744065150 msgr2=0x7fc744067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc744065150 0x7fc744067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc754005840 tx=0x7fc754009040 comp rx=0 tx=0).stop 2024-08-17T02:50:12.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 msgr2=0x7fc764069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.528 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 0x7fc764069970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c810 tx=0x7fc75c002650 comp rx=0 tx=0).stop 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 shutdown_connections 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc744065150 0x7fc744067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764155df0 0x7fc764069970 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc764155a20 0x7fc7641690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 --2- 172.21.15.149:0/1571503415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76406df00 0x7fc76414a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 >> 172.21.15.149:0/1571503415 conn(0x7fc7640cb9b0 msgr2=0x7fc7641588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 shutdown_connections 2024-08-17T02:50:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.526+0000 7fc768a00640 1 -- 172.21.15.149:0/1571503415 wait complete. 2024-08-17T02:50:12.543 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:50:11.679300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388316,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586404,"statfs":{"total":773094113280,"available":770648477696,"internally_reserved":0,"allocated":5414912,"data_stored":2941208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.905096"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:50:07.828986+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:50:07.828986+0000","last_peered":"2024-08-17T02:50:07.828986+0000","last_clean":"2024-08-17T02:50:07.828986+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:50:07.828986+0000","last_undegraded":"2024-08-17T02:50:07.828986+0000","last_fullsized":"2024-08-17T02:50:07.828986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298456,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073384,"statfs":{"total":96636764160,"available":96331145216,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":2.722,"15min":2.722},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":2.23,"15min":2.23},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.86399999999999999,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94199999999999995,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92000000000000004,"5min":2.472,"15min":2.472},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":1.423,"15min":1.423},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.876}]},{"osd":6,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":1.492,"15min":1.492},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.72299999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.48699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.68999999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.443,"15min":0.443},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.044,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.58199999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95499999999999996,"5min":1.095,"15min":1.095},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.472,"15min":1.472},"last":0.97999999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94899999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.61899999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81999999999999995,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":3.552,"15min":3.552},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83999999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94299999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67600000000000005,"5min":1.103,"15min":1.103},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":1.333,"15min":1.333},"last":0.75800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91600000000000004,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97399999999999998,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.56999999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.498,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.077,"15min":1.077},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.129,"15min":1.129},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.016,"15min":1.016},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90600000000000003,"5min":1.363,"15min":1.363},"last":0.92100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.82699999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55600000000000005,"5min":3.6120000000000001,"15min":3.6120000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83999999999999997,"5min":1.516,"15min":1.516},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65700000000000003,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70299999999999996,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":2.456,"15min":2.456},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1000000000000001,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0980000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.84299999999999997,"15min":0.86799999999999999},"min":{"1min":0.58299999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.02,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.627,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0820000000000001,"5min":1.718,"15min":1.718},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.163,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.649,"15min":2.649},"last":1.018},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.131,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.96299999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.175,"15min":1.175},"last":0.436},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":1.347,"15min":1.347},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67200000000000004,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85599999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.58399999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93899999999999995,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.623},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97999999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.88400000000000001,"15min":0.95899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0720000000000001,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.70699999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.96799999999999997},"min":{"1min":0.58299999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.143,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90000000000000002,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.006,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.70399999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.52400000000000002,"15min":0.57599999999999996},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53300000000000003,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.60899999999999999,"15min":0.67900000000000005},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.58999999999999997,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":2.274,"15min":2.274},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":3.653,"15min":3.653},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.502}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97799999999999998,"5min":1.284,"15min":1.284},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.90800000000000003,"15min":0.96399999999999997},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.86299999999999999,"15min":0.92100000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.96799999999999997,"15min":1.0660000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76900000000000002,"15min":0.74299999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.92200000000000004,"15min":0.97799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0940000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.755}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.1459999999999999,"15min":1.298},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0720000000000001,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.121,"15min":1.256},"min":{"1min":0.66800000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0549999999999999,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.74099999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":2.137,"15min":2.137},"last":0.504}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.503,"15min":0.497},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":1.516,"15min":1.516},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.63400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1040000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.88},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.071,"5min":1.603,"15min":1.603},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.99099999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.68500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0049999999999999,"5min":1.649,"15min":1.649},"last":0.80500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.675,"15min":1.675},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:12.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:12.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.692+0000 7fde3c800640 1 Processor -- start 2024-08-17T02:50:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.692+0000 7fde3c800640 1 -- start start 2024-08-17T02:50:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.693+0000 7fde3c800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde341401b0 0x7fde340caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.693+0000 7fde3c800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340caa80 con 0x7fde34140580 2024-08-17T02:50:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.693+0000 7fde3c800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340c9e70 con 0x7fde340b1440 2024-08-17T02:50:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.693+0000 7fde3c800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340cb450 con 0x7fde341401b0 2024-08-17T02:50:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.693+0000 7fde39400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fde34140580 0x7fde340b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33406/0 (socket says 172.21.15.149:33406) 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.693+0000 7fde39400640 1 -- 172.21.15.149:0/3925961424 learned_addr learned my addr 172.21.15.149:0/3925961424 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde39e00640 1 --2- 172.21.15.149:0/3925961424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde341401b0 0x7fde340caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046602257 0 0) 0x7fde340caa80 con 0x7fde34140580 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde1c0034e0 con 0x7fde34140580 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842391517 0 0) 0x7fde340c9e70 con 0x7fde340b1440 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde340caa80 con 0x7fde340b1440 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde39e00640 1 -- 172.21.15.149:0/3925961424 >> v1:172.21.15.161:6789/0 conn(0x7fde340b1440 legacy=0x7fde340c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde39e00640 1 -- 172.21.15.149:0/3925961424 >> v1:172.21.15.149:6789/0 conn(0x7fde34140580 legacy=0x7fde340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.694+0000 7fde39e00640 1 -- 172.21.15.149:0/3925961424 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340ca150 con 0x7fde341401b0 2024-08-17T02:50:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.695+0000 7fde39e00640 1 --2- 172.21.15.149:0/3925961424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde341401b0 0x7fde340caf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde28009880 tx=0x7fde280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b093a1cd167b6e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2802ad70 con 0x7fde341401b0 2024-08-17T02:50:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28032440 con 0x7fde341401b0 2024-08-17T02:50:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde38a00640 1 -- 172.21.15.149:0/3925961424 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280327e0 con 0x7fde341401b0 2024-08-17T02:50:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 -- 172.21.15.149:0/3925961424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde341401b0 msgr2=0x7fde340caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 --2- 172.21.15.149:0/3925961424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde341401b0 0x7fde340caf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde28009880 tx=0x7fde280090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 -- 172.21.15.149:0/3925961424 shutdown_connections 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 --2- 172.21.15.149:0/3925961424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde341401b0 0x7fde340caf10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 -- 172.21.15.149:0/3925961424 >> 172.21.15.149:0/3925961424 conn(0x7fde340cb9b0 msgr2=0x7fde340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 -- 172.21.15.149:0/3925961424 shutdown_connections 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.696+0000 7fde3c800640 1 -- 172.21.15.149:0/3925961424 wait complete. 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.698+0000 7fde3c800640 1 Processor -- start 2024-08-17T02:50:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.698+0000 7fde3c800640 1 -- start start 2024-08-17T02:50:12.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.698+0000 7fde3c800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde340b1440 0x7fde3413df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.702 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.698+0000 7fde3c800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 0x7fde340c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde3c800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde34140580 0x7fde340c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde3c800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340b0780 con 0x7fde341401b0 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde3c800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340afb70 con 0x7fde340b1440 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde3c800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340afe50 con 0x7fde34140580 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 0x7fde340c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 0x7fde340c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34826/0 (socket says 172.21.15.149:34826) 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 -- 172.21.15.149:0/2947875766 learned_addr learned my addr 172.21.15.149:0/2947875766 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39e00640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde340b1440 0x7fde3413df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde3a800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde34140580 0x7fde340c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 -- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde34140580 msgr2=0x7fde340c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde34140580 0x7fde340c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 -- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde340b1440 msgr2=0x7fde3413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde340b1440 0x7fde3413df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.699+0000 7fde39400640 1 -- 172.21.15.149:0/2947875766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009390 con 0x7fde341401b0 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.700+0000 7fde39400640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 0x7fde340c6780 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fde24005840 tx=0x7fde24007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.704 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.700+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24005aa0 con 0x7fde341401b0 2024-08-17T02:50:12.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.700+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde24005c00 con 0x7fde341401b0 2024-08-17T02:50:12.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.700+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde340b0130 con 0x7fde341401b0 2024-08-17T02:50:12.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.700+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde240070f0 con 0x7fde341401b0 2024-08-17T02:50:12.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.700+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3413e440 con 0x7fde341401b0 2024-08-17T02:50:12.705 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.701+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde340b08f0 con 0x7fde341401b0 2024-08-17T02:50:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.702+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde24007520 con 0x7fde341401b0 2024-08-17T02:50:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.703+0000 7fde2d600640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fde18065150 0x7fde18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.703+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fde24081b00 con 0x7fde341401b0 2024-08-17T02:50:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.703+0000 7fde39e00640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fde18065150 0x7fde18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.704+0000 7fde39e00640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fde18065150 0x7fde18067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fde28034000 tx=0x7fde28032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.707+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde2404ff90 con 0x7fde341401b0 2024-08-17T02:50:12.882 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.880+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde34064db0 con 0x7fde341401b0 2024-08-17T02:50:12.883 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.881+0000 7fde2d600640 1 -- 172.21.15.149:0/2947875766 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12441 (secure 0 0 0) 0x7fde240535b0 con 0x7fde341401b0 2024-08-17T02:50:12.883 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:12.883 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":45,"fsid":"b8d2e793-20e6-428a-8b1c-2d641058b12a","created":"2024-08-17T02:46:23.164473+0000","modified":"2024-08-17T02:50:08.093073+0000","last_up_change":"2024-08-17T02:46:34.959788+0000","last_in_change":"2024-08-17T02:46:26.094663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:35.676784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"baab8951-ed5e-48c1-8d54-07426cf7be1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37223},{"type":"v1","addr":"172.21.15.149:6801","nonce":37223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37223},{"type":"v1","addr":"172.21.15.149:6803","nonce":37223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":37223},{"type":"v1","addr":"172.21.15.149:6807","nonce":37223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37223},{"type":"v1","addr":"172.21.15.149:6805","nonce":37223}]},"public_addr":"172.21.15.149:6801/37223","cluster_addr":"172.21.15.149:6803/37223","heartbeat_back_addr":"172.21.15.149:6807/37223","heartbeat_front_addr":"172.21.15.149:6805/37223","state":["exists","up"]},{"osd":1,"uuid":"bf25ee9e-c4ab-404e-8523-087333cdb962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37225},{"type":"v1","addr":"172.21.15.149:6817","nonce":37225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":37225},{"type":"v1","addr":"172.21.15.149:6819","nonce":37225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37225},{"type":"v1","addr":"172.21.15.149:6826","nonce":37225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37225},{"type":"v1","addr":"172.21.15.149:6822","nonce":37225}]},"public_addr":"172.21.15.149:6817/37225","cluster_addr":"172.21.15.149:6819/37225","heartbeat_back_addr":"172.21.15.149:6826/37225","heartbeat_front_addr":"172.21.15.149:6822/37225","state":["exists","up"]},{"osd":2,"uuid":"b2ddc120-00a5-4eee-a5df-5feefc75e7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37224},{"type":"v1","addr":"172.21.15.149:6823","nonce":37224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":37224},{"type":"v1","addr":"172.21.15.149:6827","nonce":37224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37224},{"type":"v1","addr":"172.21.15.149:6831","nonce":37224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37224},{"type":"v1","addr":"172.21.15.149:6829","nonce":37224}]},"public_addr":"172.21.15.149:6823/37224","cluster_addr":"172.21.15.149:6827/37224","heartbeat_back_addr":"172.21.15.149:6831/37224","heartbeat_front_addr":"172.21.15.149:6829/37224","state":["exists","up"]},{"osd":3,"uuid":"c04eba6d-1aab-44bf-b36f-44e3af34ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37222},{"type":"v1","addr":"172.21.15.149:6809","nonce":37222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37222},{"type":"v1","addr":"172.21.15.149:6811","nonce":37222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37222},{"type":"v1","addr":"172.21.15.149:6815","nonce":37222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":37222},{"type":"v1","addr":"172.21.15.149:6813","nonce":37222}]},"public_addr":"172.21.15.149:6809/37222","cluster_addr":"172.21.15.149:6811/37222","heartbeat_back_addr":"172.21.15.149:6815/37222","heartbeat_front_addr":"172.21.15.149:6813/37222","state":["exists","up"]},{"osd":4,"uuid":"cca731aa-9929-427b-93b2-7fe5d82ad911","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":37094},{"type":"v1","addr":"172.21.15.161:6821","nonce":37094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37094},{"type":"v1","addr":"172.21.15.161:6825","nonce":37094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":37094},{"type":"v1","addr":"172.21.15.161:6831","nonce":37094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6827","nonce":37094},{"type":"v1","addr":"172.21.15.161:6829","nonce":37094}]},"public_addr":"172.21.15.161:6821/37094","cluster_addr":"172.21.15.161:6825/37094","heartbeat_back_addr":"172.21.15.161:6831/37094","heartbeat_front_addr":"172.21.15.161:6829/37094","state":["exists","up"]},{"osd":5,"uuid":"4339cca6-7c2a-4fc9-8359-9c7d9bd87a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37093},{"type":"v1","addr":"172.21.15.161:6809","nonce":37093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":37093},{"type":"v1","addr":"172.21.15.161:6811","nonce":37093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":37093},{"type":"v1","addr":"172.21.15.161:6815","nonce":37093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37093},{"type":"v1","addr":"172.21.15.161:6813","nonce":37093}]},"public_addr":"172.21.15.161:6809/37093","cluster_addr":"172.21.15.161:6811/37093","heartbeat_back_addr":"172.21.15.161:6815/37093","heartbeat_front_addr":"172.21.15.161:6813/37093","state":["exists","up"]},{"osd":6,"uuid":"998f3043-15f6-46ab-a89b-5c5246f12224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37092},{"type":"v1","addr":"172.21.15.161:6801","nonce":37092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37092},{"type":"v1","addr":"172.21.15.161:6803","nonce":37092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37092},{"type":"v1","addr":"172.21.15.161:6807","nonce":37092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37092},{"type":"v1","addr":"172.21.15.161:6805","nonce":37092}]},"public_addr":"172.21.15.161:6801/37092","cluster_addr":"172.21.15.161:6803/37092","heartbeat_back_addr":"172.21.15.161:6807/37092","heartbeat_front_addr":"172.21.15.161:6805/37092","state":["exists","up"]},{"osd":7,"uuid":"0c59c1a4-f5e8-466e-9eb8-b9bcd8f232c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37102},{"type":"v1","addr":"172.21.15.161:6817","nonce":37102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37102},{"type":"v1","addr":"172.21.15.161:6820","nonce":37102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":37102},{"type":"v1","addr":"172.21.15.161:6828","nonce":37102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37102},{"type":"v1","addr":"172.21.15.161:6824","nonce":37102}]},"public_addr":"172.21.15.161:6817/37102","cluster_addr":"172.21.15.161:6820/37102","heartbeat_back_addr":"172.21.15.161:6828/37102","heartbeat_front_addr":"172.21.15.161:6824/37102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.377189+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.661438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.690350+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.644409+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.494134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.380061+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.339978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:31.501645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6837/159303001":"2024-08-18T02:50:04.771577+0000","172.21.15.149:6835/159303001":"2024-08-18T02:50:04.771577+0000","172.21.15.161:6835/807513628":"2024-08-18T02:49:58.035874+0000","172.21.15.161:6833/807513628":"2024-08-18T02:49:58.035874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:12.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.883+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fde18065150 msgr2=0x7fde18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.883+0000 7fde3c800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fde18065150 0x7fde18067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fde28034000 tx=0x7fde28032000 comp rx=0 tx=0).stop 2024-08-17T02:50:12.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.883+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 msgr2=0x7fde340c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.883+0000 7fde3c800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 0x7fde340c6780 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fde24005840 tx=0x7fde24007e10 comp rx=0 tx=0).stop 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 shutdown_connections 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fde18065150 0x7fde18067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde34140580 0x7fde340c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde341401b0 0x7fde340c6780 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 --2- 172.21.15.149:0/2947875766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde340b1440 0x7fde3413df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 >> 172.21.15.149:0/2947875766 conn(0x7fde340cb9b0 msgr2=0x7fde340b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 shutdown_connections 2024-08-17T02:50:12.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:12.884+0000 7fde3c800640 1 -- 172.21.15.149:0/2947875766 wait complete. 2024-08-17T02:50:13.901 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:50:13.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.061+0000 7fa931200640 1 Processor -- start 2024-08-17T02:50:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.061+0000 7fa931200640 1 -- start start 2024-08-17T02:50:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.062+0000 7fa931200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa92c150130 0x7fa92c0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.062+0000 7fa931200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa92c156d40 0x7fa92c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.062+0000 7fa931200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c06e880 con 0x7fa92c06e420 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.062+0000 7fa931200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c1568b0 con 0x7fa92c156d40 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.062+0000 7fa931200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c150500 con 0x7fa92c150130 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa92c156d40 0x7fa92c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa92c156d40 0x7fa92c06dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34828/0 (socket says 172.21.15.149:34828) 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa92a800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa92c06e420 0x7fa92c0afbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33418/0 (socket says 172.21.15.149:33418) 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 -- 172.21.15.149:0/3424758194 learned_addr learned my addr 172.21.15.149:0/3424758194 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa929e00640 1 --2- 172.21.15.149:0/3424758194 >> v2:172.21.15.161:3300/0 conn(0x7fa92c150130 0x7fa92c0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 -- 172.21.15.149:0/3424758194 >> v2:172.21.15.161:3300/0 conn(0x7fa92c150130 msgr2=0x7fa92c0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 --2- 172.21.15.149:0/3424758194 >> v2:172.21.15.161:3300/0 conn(0x7fa92c150130 0x7fa92c0aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 -- 172.21.15.149:0/3424758194 >> v1:172.21.15.149:6789/0 conn(0x7fa92c06e420 legacy=0x7fa92c0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.063+0000 7fa921400640 1 -- 172.21.15.149:0/3424758194 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c155fc0 con 0x7fa92c156d40 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.064+0000 7fa921400640 1 --2- 172.21.15.149:0/3424758194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c156d40 0x7fa92c06dee0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06f670 tx=0x7fa9140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b220e6385379ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.064+0000 7fa929400640 1 -- 172.21.15.149:0/3424758194 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91402add0 con 0x7fa92c156d40 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa929400640 1 -- 172.21.15.149:0/3424758194 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914032440 con 0x7fa92c156d40 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa929400640 1 -- 172.21.15.149:0/3424758194 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914032820 con 0x7fa92c156d40 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 -- 172.21.15.149:0/3424758194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c156d40 msgr2=0x7fa92c06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 --2- 172.21.15.149:0/3424758194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c156d40 0x7fa92c06dee0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06f670 tx=0x7fa9140091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 -- 172.21.15.149:0/3424758194 shutdown_connections 2024-08-17T02:50:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 --2- 172.21.15.149:0/3424758194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c156d40 0x7fa92c06dee0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 --2- 172.21.15.149:0/3424758194 >> v2:172.21.15.161:3300/0 conn(0x7fa92c150130 0x7fa92c0aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 -- 172.21.15.149:0/3424758194 >> 172.21.15.149:0/3424758194 conn(0x7fa92c067750 msgr2=0x7fa92c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 -- 172.21.15.149:0/3424758194 shutdown_connections 2024-08-17T02:50:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.065+0000 7fa931200640 1 -- 172.21.15.149:0/3424758194 wait complete. 2024-08-17T02:50:14.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.067+0000 7fa931200640 1 Processor -- start 2024-08-17T02:50:14.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.067+0000 7fa931200640 1 -- start start 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa931200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa92c06e420 0x7fa92c13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa931200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c150130 0x7fa92c13bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa931200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa92c156d40 0x7fa92c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa931200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c15c370 con 0x7fa92c150130 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa931200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c13b9f0 con 0x7fa92c06e420 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa931200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c14f640 con 0x7fa92c156d40 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c150130 0x7fa92c13bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c150130 0x7fa92c13bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34830/0 (socket says 172.21.15.149:34830) 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 -- 172.21.15.149:0/2327481817 learned_addr learned my addr 172.21.15.149:0/2327481817 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa929e00640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa92c06e420 0x7fa92c13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa92a800640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa92c156d40 0x7fa92c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 -- 172.21.15.149:0/2327481817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa92c156d40 msgr2=0x7fa92c15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa92c156d40 0x7fa92c15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 -- 172.21.15.149:0/2327481817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa92c06e420 msgr2=0x7fa92c13b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa92c06e420 0x7fa92c13b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.068+0000 7fa921400640 1 -- 172.21.15.149:0/2327481817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009450 con 0x7fa92c150130 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.069+0000 7fa921400640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c150130 0x7fa92c13bd00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa914009210 tx=0x7fa914032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.069+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914031c80 con 0x7fa92c150130 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.069+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914031e00 con 0x7fa92c150130 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.069+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91403d670 con 0x7fa92c150130 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.069+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c15b480 con 0x7fa92c150130 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.069+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c15ba40 con 0x7fa92c150130 2024-08-17T02:50:14.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.070+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa92c0710c0 con 0x7fa92c150130 2024-08-17T02:50:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.071+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa914039040 con 0x7fa92c150130 2024-08-17T02:50:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa922000640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa908065180 0x7fa908067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa9140a1fe0 con 0x7fa92c150130 2024-08-17T02:50:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa929e00640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa908065180 0x7fa908067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa922000640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7fa90806b070 0x7fa90806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 --> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa90806db30 con 0x7fa90806b070 2024-08-17T02:50:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9140a4560 con 0x7fa92c150130 2024-08-17T02:50:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa92a800640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7fa90806b070 0x7fa90806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.072+0000 7fa929e00640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa908065180 0x7fa908067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009d20 tx=0x7fa91c0090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.073+0000 7fa92a800640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7fa90806b070 0x7fa90806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.073+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== osd.0 v2:172.21.15.149:6800/37223 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa90806db30 con 0x7fa90806b070 2024-08-17T02:50:14.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.086+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 --> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa92c070740 con 0x7fa90806b070 2024-08-17T02:50:14.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.086+0000 7fa922000640 1 -- 172.21.15.149:0/2327481817 <== osd.0 v2:172.21.15.149:6800/37223 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa92c070740 con 0x7fa90806b070 2024-08-17T02:50:14.088 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:14.088 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:14.088 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:14.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7fa90806b070 msgr2=0x7fa90806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6800/37223,v1:172.21.15.149:6801/37223] conn(0x7fa90806b070 0x7fa90806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa908065180 msgr2=0x7fa908067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fa908065180 0x7fa908067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009d20 tx=0x7fa91c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c150130 msgr2=0x7fa92c13bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 --2- 172.21.15.149:0/2327481817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa92c150130 0x7fa92c13bd00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa914009210 tx=0x7fa914032000 comp rx=0 tx=0).stop 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa92a800640 1 -- 172.21.15.149:0/2327481817 reap_dead start 2024-08-17T02:50:14.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 shutdown_connections 2024-08-17T02:50:14.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 >> 172.21.15.149:0/2327481817 conn(0x7fa92c067750 msgr2=0x7fa92c069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 shutdown_connections 2024-08-17T02:50:14.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.087+0000 7fa931200640 1 -- 172.21.15.149:0/2327481817 wait complete. 2024-08-17T02:50:14.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:50:14.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.250+0000 7f2535600640 1 Processor -- start 2024-08-17T02:50:14.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.251+0000 7f2535600640 1 -- start start 2024-08-17T02:50:14.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2535600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 0x7f2530155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2535600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f25300b0270 0x7f2530156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2535600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2530157690 con 0x7f2530157b20 2024-08-17T02:50:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2535600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2530156a80 con 0x7f25300b0270 2024-08-17T02:50:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2535600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530156d60 con 0x7f2530155900 2024-08-17T02:50:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2534c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2530157b20 0x7f2530157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33424/0 (socket says 172.21.15.149:33424) 2024-08-17T02:50:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.252+0000 7f2534c00640 1 -- 172.21.15.149:0/4250149836 learned_addr learned my addr 172.21.15.149:0/4250149836 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252fe00640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 0x7f2530155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f2527400640 1 --2- 172.21.15.149:0/4250149836 >> v2:172.21.15.161:3300/0 conn(0x7f25300b0270 0x7f2530156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085536080 0 0) 0x7f2530157690 con 0x7f2530157b20 2024-08-17T02:50:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25140034e0 con 0x7f2530157b20 2024-08-17T02:50:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330121996 0 0) 0x7f25140034e0 con 0x7f2530157b20 2024-08-17T02:50:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 msgr2=0x7f2530155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 0x7f2530155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 >> v2:172.21.15.161:3300/0 conn(0x7f25300b0270 msgr2=0x7f2530156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 --2- 172.21.15.149:0/4250149836 >> v2:172.21.15.161:3300/0 conn(0x7f25300b0270 0x7f2530156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530157040 con 0x7f2530157b20 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f25280017f0 con 0x7f2530157b20 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 >> v1:172.21.15.149:6789/0 conn(0x7f2530157b20 legacy=0x7f2530157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 0x7f2514003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2514003f80 0x7f2514004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2514004cc0 0x7f2514005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530156a80 con 0x7f2514004cc0 2024-08-17T02:50:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530156d60 con 0x7f2514003f80 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251400ba20 con 0x7f2530155900 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.253+0000 7f2534c00640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2514004cc0 0x7f2514005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f252fe00640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 0x7f2514003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f2527400640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2514003f80 0x7f2514004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f2534c00640 1 -- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 msgr2=0x7f2514003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f2534c00640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2530155900 0x7f2514003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f2534c00640 1 -- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2514003f80 msgr2=0x7f2514004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f2534c00640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2514003f80 0x7f2514004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.254+0000 7f2534c00640 1 -- 172.21.15.149:0/4250149836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140034e0 con 0x7f2514004cc0 2024-08-17T02:50:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.255+0000 7f2534c00640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2514004cc0 0x7f2514005130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f252800a900 tx=0x7f2530157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3093e5b7b94e02ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.255+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280070f0 con 0x7f2514004cc0 2024-08-17T02:50:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.255+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528007270 con 0x7f2514004cc0 2024-08-17T02:50:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.255+0000 7f252f400640 1 -- 172.21.15.149:0/4250149836 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528007630 con 0x7f2514004cc0 2024-08-17T02:50:14.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2535600640 1 -- 172.21.15.149:0/4250149836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2514004cc0 msgr2=0x7f2514005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2535600640 1 --2- 172.21.15.149:0/4250149836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2514004cc0 0x7f2514005130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f252800a900 tx=0x7f2530157600 comp rx=0 tx=0).stop 2024-08-17T02:50:14.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2534c00640 1 -- 172.21.15.149:0/4250149836 reap_dead start 2024-08-17T02:50:14.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2535600640 1 -- 172.21.15.149:0/4250149836 shutdown_connections 2024-08-17T02:50:14.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2535600640 1 -- 172.21.15.149:0/4250149836 >> 172.21.15.149:0/4250149836 conn(0x7f2530067750 msgr2=0x7f25300cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2535600640 1 -- 172.21.15.149:0/4250149836 shutdown_connections 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.256+0000 7f2535600640 1 -- 172.21.15.149:0/4250149836 wait complete. 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.257+0000 7f2535600640 1 Processor -- start 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.257+0000 7f2535600640 1 -- start start 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2535600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2514004cc0 0x7f25301470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2535600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 0x7f2530140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2535600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2530140660 0x7f253013e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2535600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530169ef0 con 0x7f2530169730 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2535600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253016a1d0 con 0x7f2530140660 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2535600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253016a4b0 con 0x7f2514004cc0 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2527400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 0x7f2530140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2527400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 0x7f2530140120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34838/0 (socket says 172.21.15.149:34838) 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2527400640 1 -- 172.21.15.149:0/4024100467 learned_addr learned my addr 172.21.15.149:0/4024100467 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.258+0000 7f2534c00640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2530140660 0x7f253013e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f252fe00640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2514004cc0 0x7f25301470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527400640 1 -- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2514004cc0 msgr2=0x7f25301470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527400640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2514004cc0 0x7f25301470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527400640 1 -- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2530140660 msgr2=0x7f253013e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527400640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2530140660 0x7f253013e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527400640 1 -- 172.21.15.149:0/4024100467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253016a790 con 0x7f2530169730 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527400640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 0x7f2530140120 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2518011a60 tx=0x7f25180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800fb00 con 0x7f2530169730 2024-08-17T02:50:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800fc60 con 0x7f2530169730 2024-08-17T02:50:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.259+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518014440 con 0x7f2530169730 2024-08-17T02:50:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.260+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253016aa70 con 0x7f2530169730 2024-08-17T02:50:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.260+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300a56b0 con 0x7f2530169730 2024-08-17T02:50:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.261+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530071050 con 0x7f2530169730 2024-08-17T02:50:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.261+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2518014870 con 0x7f2530169730 2024-08-17T02:50:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.262+0000 7f2527e00640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f250c065150 0x7f250c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.262+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2518018030 con 0x7f2530169730 2024-08-17T02:50:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.262+0000 7f252fe00640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f250c065150 0x7f250c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.263+0000 7f252fe00640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f250c065150 0x7f250c067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2520006e70 tx=0x7f25200090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.267+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2518050f80 con 0x7f2530169730 2024-08-17T02:50:14.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.438+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f253006f480 con 0x7f250c065150 2024-08-17T02:50:14.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.438+0000 7f2527e00640 1 -- 172.21.15.149:0/4024100467 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f253006f480 con 0x7f250c065150 2024-08-17T02:50:14.440 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:50:14.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f250c065150 msgr2=0x7f250c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f250c065150 0x7f250c067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2520006e70 tx=0x7f25200090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 msgr2=0x7f2530140120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 0x7f2530140120 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2518011a60 tx=0x7f25180090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 shutdown_connections 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f250c065150 0x7f250c067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2530140660 0x7f253013e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2530169730 0x7f2530140120 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 --2- 172.21.15.149:0/4024100467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2514004cc0 0x7f25301470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.440+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 >> 172.21.15.149:0/4024100467 conn(0x7f2530067750 msgr2=0x7f25300685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.441+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 shutdown_connections 2024-08-17T02:50:14.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.441+0000 7f2535600640 1 -- 172.21.15.149:0/4024100467 wait complete. 2024-08-17T02:50:14.457 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:50:14.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:14.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.609+0000 7fbdda400640 1 Processor -- start 2024-08-17T02:50:14.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.610+0000 7fbdda400640 1 -- start start 2024-08-17T02:50:14.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdda400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40b2ef0 0x7fbdd40b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdda400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdd40ab790 0x7fbdd40abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdda400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40ad350 con 0x7fbdd40b0830 2024-08-17T02:50:14.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdda400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40b1d20 con 0x7fbdd40ab790 2024-08-17T02:50:14.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdda400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40b3800 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdd3e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbdd40b0830 0x7fbdd40b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33434/0 (socket says 172.21.15.149:33434) 2024-08-17T02:50:14.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdd3e00640 1 -- 172.21.15.149:0/1622775785 learned_addr learned my addr 172.21.15.149:0/1622775785 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:14.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdd9000640 1 --2- 172.21.15.149:0/1622775785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40b2ef0 0x7fbdd40b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdd9a00640 1 --2- 172.21.15.149:0/1622775785 >> v2:172.21.15.161:3300/0 conn(0x7fbdd40ab790 0x7fbdd40abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.611+0000 7fbdd3400640 1 -- 172.21.15.149:0/1622775785 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144607090 0 0) 0x7fbdd40ad350 con 0x7fbdd40b0830 2024-08-17T02:50:14.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.612+0000 7fbdd3400640 1 -- 172.21.15.149:0/1622775785 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdbc0034e0 con 0x7fbdd40b0830 2024-08-17T02:50:14.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.612+0000 7fbdd3400640 1 -- 172.21.15.149:0/1622775785 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950487472 0 0) 0x7fbdbc0034e0 con 0x7fbdd40b0830 2024-08-17T02:50:14.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.612+0000 7fbdd9000640 1 -- 172.21.15.149:0/1622775785 >> v2:172.21.15.161:3300/0 conn(0x7fbdd40ab790 msgr2=0x7fbdd40abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.612+0000 7fbdd9000640 1 --2- 172.21.15.149:0/1622775785 >> v2:172.21.15.161:3300/0 conn(0x7fbdd40ab790 0x7fbdd40abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.612+0000 7fbdd9000640 1 -- 172.21.15.149:0/1622775785 >> v1:172.21.15.149:6789/0 conn(0x7fbdd40b0830 legacy=0x7fbdd40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.612+0000 7fbdd9000640 1 -- 172.21.15.149:0/1622775785 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40b0cf0 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.613+0000 7fbdd9000640 1 --2- 172.21.15.149:0/1622775785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40b2ef0 0x7fbdd40b32c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009850 tx=0x7fbdc80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f493057feea843 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.613+0000 7fbdd3400640 1 -- 172.21.15.149:0/1622775785 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0001470 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.613+0000 7fbdd3400640 1 -- 172.21.15.149:0/1622775785 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc802aa50 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.613+0000 7fbdd3400640 1 -- 172.21.15.149:0/1622775785 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc802adf0 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 -- 172.21.15.149:0/1622775785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40b2ef0 msgr2=0x7fbdd40b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 --2- 172.21.15.149:0/1622775785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40b2ef0 0x7fbdd40b32c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009850 tx=0x7fbdc80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 -- 172.21.15.149:0/1622775785 shutdown_connections 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 --2- 172.21.15.149:0/1622775785 >> v2:172.21.15.161:3300/0 conn(0x7fbdd40ab790 0x7fbdd40abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 --2- 172.21.15.149:0/1622775785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40b2ef0 0x7fbdd40b32c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 -- 172.21.15.149:0/1622775785 >> 172.21.15.149:0/1622775785 conn(0x7fbdd4096a70 msgr2=0x7fbdd4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 -- 172.21.15.149:0/1622775785 shutdown_connections 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.614+0000 7fbdda400640 1 -- 172.21.15.149:0/1622775785 wait complete. 2024-08-17T02:50:14.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.615+0000 7fbdda400640 1 Processor -- start 2024-08-17T02:50:14.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.615+0000 7fbdda400640 1 -- start start 2024-08-17T02:50:14.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.616+0000 7fbdda400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40ab790 0x7fbdd414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.616+0000 7fbdda400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdd40b0830 0x7fbdd40ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.616+0000 7fbdda400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40b2ef0 0x7fbdd40adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.616+0000 7fbdda400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40689c0 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.616+0000 7fbdda400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd414bf10 con 0x7fbdd40b0830 2024-08-17T02:50:14.621 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.616+0000 7fbdda400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40af840 con 0x7fbdd40ab790 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40b2ef0 0x7fbdd40adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40b2ef0 0x7fbdd40adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34842/0 (socket says 172.21.15.149:34842) 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 -- 172.21.15.149:0/733561172 learned_addr learned my addr 172.21.15.149:0/733561172 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9000640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40ab790 0x7fbdd414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd3e00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdd40b0830 0x7fbdd40ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 -- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40ab790 msgr2=0x7fbdd414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdd40ab790 0x7fbdd414b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 -- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdd40b0830 msgr2=0x7fbdd40ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdd40b0830 0x7fbdd40ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 -- 172.21.15.149:0/733561172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8009390 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd3e00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdd40b0830 0x7fbdd40ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.617+0000 7fbdd9a00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40b2ef0 0x7fbdd40adde0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009ec0 tx=0x7fbdcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.618+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc00ce10 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.623 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.618+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00f040 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.618+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd40b0410 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.618+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0146d0 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.618+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd40afdc0 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.619+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdd4063d20 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.620+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbdcc014a80 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.620+0000 7fbdc7e00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbdb4065150 0x7fbdb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.620+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbdcc082f70 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.625 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdd9000640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbdb4065150 0x7fbdb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdc7e00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7fbdb406b040 0x7fbdb406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 --> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdb406db00 con 0x7fbdb406b040 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdcc0854d0 con 0x7fbdd40b2ef0 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdd3e00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7fbdb406b040 0x7fbdb406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdd9000640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbdb4065150 0x7fbdb4067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8034000 tx=0x7fbdc8032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.621+0000 7fbdd3e00640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7fbdb406b040 0x7fbdb406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.622+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== osd.1 v2:172.21.15.149:6816/37225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbdb406db00 con 0x7fbdb406b040 2024-08-17T02:50:14.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 --> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbdd4071050 con 0x7fbdb406b040 2024-08-17T02:50:14.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdc7e00640 1 -- 172.21.15.149:0/733561172 <== osd.1 v2:172.21.15.149:6816/37225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbdd4071050 con 0x7fbdb406b040 2024-08-17T02:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:14.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7fbdb406b040 msgr2=0x7fbdb406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6816/37225,v1:172.21.15.149:6817/37225] conn(0x7fbdb406b040 0x7fbdb406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbdb4065150 msgr2=0x7fbdb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbdb4065150 0x7fbdb4067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8034000 tx=0x7fbdc8032000 comp rx=0 tx=0).stop 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40b2ef0 msgr2=0x7fbdd40adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdda400640 1 --2- 172.21.15.149:0/733561172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40b2ef0 0x7fbdd40adde0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009ec0 tx=0x7fbdcc00b040 comp rx=0 tx=0).stop 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.635+0000 7fbdd9a00640 1 -- 172.21.15.149:0/733561172 reap_dead start 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.636+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 shutdown_connections 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.636+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 >> 172.21.15.149:0/733561172 conn(0x7fbdd4096a70 msgr2=0x7fbdd406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.636+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 shutdown_connections 2024-08-17T02:50:14.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.636+0000 7fbdda400640 1 -- 172.21.15.149:0/733561172 wait complete. 2024-08-17T02:50:14.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:50:14.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.799+0000 7f0729200640 1 Processor -- start 2024-08-17T02:50:14.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.799+0000 7f0729200640 1 -- start start 2024-08-17T02:50:14.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0729200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0724155a20 0x7f07240adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0729200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f072406df00 0x7f07240ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0729200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0724156670 con 0x7f0724155df0 2024-08-17T02:50:14.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0729200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240b0350 con 0x7f0724155a20 2024-08-17T02:50:14.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0729200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072406e5e0 con 0x7f072406df00 2024-08-17T02:50:14.803 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0721e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0724155a20 0x7f07240adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0719400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0724155df0 0x7f072406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33442/0 (socket says 172.21.15.149:33442) 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0719400640 1 -- 172.21.15.149:0/3608110466 learned_addr learned my addr 172.21.15.149:0/3608110466 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0722800640 1 --2- 172.21.15.149:0/3608110466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f072406df00 0x7f07240ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0721e00640 1 -- 172.21.15.149:0/3608110466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f072406df00 msgr2=0x7f07240ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0721e00640 1 --2- 172.21.15.149:0/3608110466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f072406df00 0x7f07240ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0721e00640 1 -- 172.21.15.149:0/3608110466 >> v1:172.21.15.149:6789/0 conn(0x7f0724155df0 legacy=0x7f072406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.804 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0721e00640 1 -- 172.21.15.149:0/3608110466 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072406e8c0 con 0x7f0724155a20 2024-08-17T02:50:14.805 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.801+0000 7f0721400640 1 -- 172.21.15.149:0/3608110466 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329830990 0 0) 0x7f0724156670 con 0x7f0724155df0 2024-08-17T02:50:14.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.802+0000 7f0721e00640 1 --2- 172.21.15.149:0/3608110466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f07240adf10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0714009850 tx=0x7f07140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a859be2896453d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0721400640 1 -- 172.21.15.149:0/3608110466 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071402ad90 con 0x7f0724155a20 2024-08-17T02:50:14.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0721400640 1 -- 172.21.15.149:0/3608110466 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714032440 con 0x7f0724155a20 2024-08-17T02:50:14.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0721400640 1 -- 172.21.15.149:0/3608110466 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140327e0 con 0x7f0724155a20 2024-08-17T02:50:14.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 -- 172.21.15.149:0/3608110466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 msgr2=0x7f07240adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 --2- 172.21.15.149:0/3608110466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f07240adf10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0714009850 tx=0x7f07140090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 -- 172.21.15.149:0/3608110466 shutdown_connections 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 --2- 172.21.15.149:0/3608110466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f072406df00 0x7f07240ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 --2- 172.21.15.149:0/3608110466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f07240adf10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 -- 172.21.15.149:0/3608110466 >> 172.21.15.149:0/3608110466 conn(0x7f07240cb9b0 msgr2=0x7f07240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 -- 172.21.15.149:0/3608110466 shutdown_connections 2024-08-17T02:50:14.807 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.803+0000 7f0729200640 1 -- 172.21.15.149:0/3608110466 wait complete. 2024-08-17T02:50:14.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.805+0000 7f0729200640 1 Processor -- start 2024-08-17T02:50:14.808 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.805+0000 7f0729200640 1 -- start start 2024-08-17T02:50:14.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0729200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072406df00 0x7f0724148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0729200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f0724150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0729200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0724155df0 0x7f0724150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0729200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072414f9a0 con 0x7f0724155a20 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0729200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724148bd0 con 0x7f072406df00 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0729200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0724151d80 con 0x7f0724155df0 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f0724150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f0724150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34852/0 (socket says 172.21.15.149:34852) 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 -- 172.21.15.149:0/2479871587 learned_addr learned my addr 172.21.15.149:0/2479871587 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0721e00640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072406df00 0x7f0724148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0722800640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0724155df0 0x7f0724150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 -- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0724155df0 msgr2=0x7f0724150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0724155df0 0x7f0724150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 -- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072406df00 msgr2=0x7f0724148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072406df00 0x7f0724148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.806+0000 7f0719400640 1 -- 172.21.15.149:0/2479871587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714009390 con 0x7f0724155a20 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.807+0000 7f0719400640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f0724150590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c4f0 tx=0x7f070c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.807+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c005aa0 con 0x7f0724155a20 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.807+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c005c00 con 0x7f0724155a20 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.807+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0724152210 con 0x7f0724155a20 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.807+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0070d0 con 0x7f0724155a20 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.807+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0724151450 con 0x7f0724155a20 2024-08-17T02:50:14.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.808+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724151ef0 con 0x7f0724155a20 2024-08-17T02:50:14.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.809+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f070c007500 con 0x7f0724155a20 2024-08-17T02:50:14.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.810+0000 7f071a000640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0700065150 0x7f0700067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.810+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f070c081700 con 0x7f0724155a20 2024-08-17T02:50:14.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.810+0000 7f0721e00640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0700065150 0x7f0700067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.811+0000 7f0721e00640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0700065150 0x7f0700067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0714034000 tx=0x7f0714032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.814+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f070c04f9c0 con 0x7f0724155a20 2024-08-17T02:50:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.985+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0724064db0 con 0x7f0700065150 2024-08-17T02:50:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.986+0000 7f071a000640 1 -- 172.21.15.149:0/2479871587 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0724064db0 con 0x7f0700065150 2024-08-17T02:50:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:50:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0700065150 msgr2=0x7f0700067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0700065150 0x7f0700067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0714034000 tx=0x7f0714032000 comp rx=0 tx=0).stop 2024-08-17T02:50:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 msgr2=0x7f0724150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f0724150590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c4f0 tx=0x7f070c007f50 comp rx=0 tx=0).stop 2024-08-17T02:50:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 shutdown_connections 2024-08-17T02:50:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0700065150 0x7f0700067600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0724155df0 0x7f0724150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0724155a20 0x7f0724150590 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 --2- 172.21.15.149:0/2479871587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072406df00 0x7f0724148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 >> 172.21.15.149:0/2479871587 conn(0x7f07240cb9b0 msgr2=0x7f072406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 shutdown_connections 2024-08-17T02:50:14.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:14.988+0000 7f0729200640 1 -- 172.21.15.149:0/2479871587 wait complete. 2024-08-17T02:50:15.005 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:50:15.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.158+0000 7f46da400640 1 Processor -- start 2024-08-17T02:50:15.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.158+0000 7f46da400640 1 -- start start 2024-08-17T02:50:15.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46da400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46d40adc00 0x7f46d40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46da400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b11e0 0x7f46d40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46da400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d40b0030 con 0x7f46d40b59f0 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46da400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d40aefc0 con 0x7f46d40adc00 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46da400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40af2a0 con 0x7f46d40b11e0 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46d3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46d40adc00 0x7f46d40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46d3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46d40adc00 0x7f46d40b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34860/0 (socket says 172.21.15.149:34860) 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.159+0000 7f46d3400640 1 -- 172.21.15.149:0/255612475 learned_addr learned my addr 172.21.15.149:0/255612475 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.160+0000 7f46d3e00640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b11e0 0x7f46d40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.160+0000 7f46d3400640 1 -- 172.21.15.149:0/255612475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b11e0 msgr2=0x7f46d40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.162 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.160+0000 7f46d3400640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b11e0 0x7f46d40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.160+0000 7f46d3400640 1 -- 172.21.15.149:0/255612475 >> v1:172.21.15.161:6789/0 conn(0x7f46d40b59f0 legacy=0x7f46d40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.160+0000 7f46d3400640 1 -- 172.21.15.149:0/255612475 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40b02d0 con 0x7f46d40adc00 2024-08-17T02:50:15.163 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.160+0000 7f46d3e00640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b11e0 0x7f46d40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:15.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.161+0000 7f46d3400640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d40b2ce0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009910 tx=0x7f46c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6122833cc014fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.161+0000 7f46d2000640 1 -- 172.21.15.149:0/255612475 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c402adb0 con 0x7f46d40adc00 2024-08-17T02:50:15.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.161+0000 7f46d2000640 1 -- 172.21.15.149:0/255612475 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c4032440 con 0x7f46d40adc00 2024-08-17T02:50:15.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.161+0000 7f46d2000640 1 -- 172.21.15.149:0/255612475 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4032820 con 0x7f46d40adc00 2024-08-17T02:50:15.164 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 -- 172.21.15.149:0/255612475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 msgr2=0x7f46d40b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d40b2ce0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009910 tx=0x7f46c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 -- 172.21.15.149:0/255612475 shutdown_connections 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b11e0 0x7f46d40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 --2- 172.21.15.149:0/255612475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d40b2ce0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 -- 172.21.15.149:0/255612475 >> 172.21.15.149:0/255612475 conn(0x7f46d40cfdb0 msgr2=0x7f46d40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 -- 172.21.15.149:0/255612475 shutdown_connections 2024-08-17T02:50:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.162+0000 7f46da400640 1 -- 172.21.15.149:0/255612475 wait complete. 2024-08-17T02:50:15.167 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.163+0000 7f46da400640 1 Processor -- start 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.164+0000 7f46da400640 1 -- start start 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.164+0000 7f46da400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d4155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.164+0000 7f46da400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46d40b11e0 0x7f46d4169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.164+0000 7f46da400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b59f0 0x7f46d415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46da400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4169e80 con 0x7f46d40adc00 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46da400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4157000 con 0x7f46d40b11e0 2024-08-17T02:50:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46da400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d415b260 con 0x7f46d40b59f0 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d4155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d4155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34874/0 (socket says 172.21.15.149:34874) 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 -- 172.21.15.149:0/4285975672 learned_addr learned my addr 172.21.15.149:0/4285975672 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d2a00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46d40b11e0 0x7f46d4169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3e00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b59f0 0x7f46d415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 -- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b59f0 msgr2=0x7f46d415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b59f0 0x7f46d415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 -- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46d40b11e0 msgr2=0x7f46d4169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46d40b11e0 0x7f46d4169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 -- 172.21.15.149:0/4285975672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4009450 con 0x7f46d40adc00 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3e00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46d40b59f0 0x7f46d415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.165+0000 7f46d3400640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d4155cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009970 tx=0x7f46c4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.166+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4031de0 con 0x7f46d40adc00 2024-08-17T02:50:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.166+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c403d420 con 0x7f46d40adc00 2024-08-17T02:50:15.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.166+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c403d7e0 con 0x7f46d40adc00 2024-08-17T02:50:15.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.166+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d41563f0 con 0x7f46d40adc00 2024-08-17T02:50:15.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.166+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d41569b0 con 0x7f46d40adc00 2024-08-17T02:50:15.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.167+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46d40710c0 con 0x7f46d40adc00 2024-08-17T02:50:15.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.167+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f46c4039040 con 0x7f46d40adc00 2024-08-17T02:50:15.172 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.168+0000 7f46caa00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f46b4065150 0x7f46b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.168+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f46c40a2270 con 0x7f46d40adc00 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.168+0000 7f46d2a00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f46b4065150 0x7f46b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.168+0000 7f46caa00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f46b406b040 0x7f46b406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.168+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 --> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46b406db00 con 0x7f46b406b040 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.168+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46c40a47d0 con 0x7f46d40adc00 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.169+0000 7f46d3e00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f46b406b040 0x7f46b406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.169+0000 7f46d2a00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f46b4065150 0x7f46b4067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46d4069510 tx=0x7f46c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.169+0000 7f46d3e00640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f46b406b040 0x7f46b406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.174 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.170+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== osd.2 v2:172.21.15.149:6821/37224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f46b406db00 con 0x7f46b406b040 2024-08-17T02:50:15.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 --> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46d4070430 con 0x7f46b406b040 2024-08-17T02:50:15.184 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46caa00640 1 -- 172.21.15.149:0/4285975672 <== osd.2 v2:172.21.15.149:6821/37224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f46d4070430 con 0x7f46b406b040 2024-08-17T02:50:15.184 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:15.185 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:15.185 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:15.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f46b406b040 msgr2=0x7f46b406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6821/37224,v1:172.21.15.149:6823/37224] conn(0x7f46b406b040 0x7f46b406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f46b4065150 msgr2=0x7f46b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f46b4065150 0x7f46b4067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46d4069510 tx=0x7f46c0009040 comp rx=0 tx=0).stop 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 msgr2=0x7f46d4155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46da400640 1 --2- 172.21.15.149:0/4285975672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46d40adc00 0x7f46d4155cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009970 tx=0x7f46c4032000 comp rx=0 tx=0).stop 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.183+0000 7f46d3e00640 1 -- 172.21.15.149:0/4285975672 reap_dead start 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.184+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 shutdown_connections 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.184+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 >> 172.21.15.149:0/4285975672 conn(0x7f46d40cfdb0 msgr2=0x7f46d4151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.184+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 shutdown_connections 2024-08-17T02:50:15.187 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.184+0000 7f46da400640 1 -- 172.21.15.149:0/4285975672 wait complete. 2024-08-17T02:50:15.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:50:15.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.349+0000 7fbd93600640 1 Processor -- start 2024-08-17T02:50:15.351 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.349+0000 7fbd93600640 1 -- start start 2024-08-17T02:50:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.350+0000 7fbd93600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbd8c0b1440 0x7fbd8c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.350+0000 7fbd93600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbd8c140580 0x7fbd8c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.350+0000 7fbd93600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c0caa80 con 0x7fbd8c1401b0 2024-08-17T02:50:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.350+0000 7fbd93600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0cb450 con 0x7fbd8c140580 2024-08-17T02:50:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.350+0000 7fbd93600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0c9e70 con 0x7fbd8c0b1440 2024-08-17T02:50:15.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbd8c140580 0x7fbd8c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbd8c140580 0x7fbd8c0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34886/0 (socket says 172.21.15.149:34886) 2024-08-17T02:50:15.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 -- 172.21.15.149:0/2951767378 learned_addr learned my addr 172.21.15.149:0/2951767378 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd8be00640 1 --2- 172.21.15.149:0/2951767378 >> v2:172.21.15.161:3300/0 conn(0x7fbd8c0b1440 0x7fbd8c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 -- 172.21.15.149:0/2951767378 >> v2:172.21.15.161:3300/0 conn(0x7fbd8c0b1440 msgr2=0x7fbd8c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 --2- 172.21.15.149:0/2951767378 >> v2:172.21.15.161:3300/0 conn(0x7fbd8c0b1440 0x7fbd8c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 -- 172.21.15.149:0/2951767378 >> v1:172.21.15.161:6789/0 conn(0x7fbd8c1401b0 legacy=0x7fbd8c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.351+0000 7fbd91600640 1 -- 172.21.15.149:0/2951767378 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0ca150 con 0x7fbd8c140580 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.352+0000 7fbd91600640 1 --2- 172.21.15.149:0/2951767378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c140580 0x7fbd8c0c9040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c06aa80 tx=0x7fbd84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b86cdf6305d6d1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.352+0000 7fbd8b400640 1 -- 172.21.15.149:0/2951767378 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84032400 con 0x7fbd8c140580 2024-08-17T02:50:15.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.352+0000 7fbd8b400640 1 -- 172.21.15.149:0/2951767378 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8402e050 con 0x7fbd8c140580 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.352+0000 7fbd8b400640 1 -- 172.21.15.149:0/2951767378 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840327f0 con 0x7fbd8c140580 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 -- 172.21.15.149:0/2951767378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c140580 msgr2=0x7fbd8c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 --2- 172.21.15.149:0/2951767378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c140580 0x7fbd8c0c9040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c06aa80 tx=0x7fbd84009840 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 -- 172.21.15.149:0/2951767378 shutdown_connections 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 --2- 172.21.15.149:0/2951767378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c140580 0x7fbd8c0c9040 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 --2- 172.21.15.149:0/2951767378 >> v2:172.21.15.161:3300/0 conn(0x7fbd8c0b1440 0x7fbd8c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 -- 172.21.15.149:0/2951767378 >> 172.21.15.149:0/2951767378 conn(0x7fbd8c0cb9b0 msgr2=0x7fbd8c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 -- 172.21.15.149:0/2951767378 shutdown_connections 2024-08-17T02:50:15.357 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.353+0000 7fbd93600640 1 -- 172.21.15.149:0/2951767378 wait complete. 2024-08-17T02:50:15.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.354+0000 7fbd93600640 1 Processor -- start 2024-08-17T02:50:15.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 -- start start 2024-08-17T02:50:15.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 0x7fbd8c137b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd8c1401b0 0x7fbd8c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd8c140580 0x7fbd8c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.359 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c138d80 con 0x7fbd8c0b1440 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15baf0 con 0x7fbd8c1401b0 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.355+0000 7fbd93600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c138170 con 0x7fbd8c140580 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 0x7fbd8c137b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 0x7fbd8c137b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34894/0 (socket says 172.21.15.149:34894) 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 -- 172.21.15.149:0/1307373612 learned_addr learned my addr 172.21.15.149:0/1307373612 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd8be00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd8c1401b0 0x7fbd8c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd91600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd8c140580 0x7fbd8c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 -- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd8c140580 msgr2=0x7fbd8c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd8c140580 0x7fbd8c156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 -- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd8c1401b0 msgr2=0x7fbd8c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd8c1401b0 0x7fbd8c15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 -- 172.21.15.149:0/1307373612 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009ae0 con 0x7fbd8c0b1440 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd8be00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd8c1401b0 0x7fbd8c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd91600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd8c140580 0x7fbd8c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd90c00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 0x7fbd8c137b40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c560 tx=0x7fbd80007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.356+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80011590 con 0x7fbd8c0b1440 2024-08-17T02:50:15.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.357+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80011710 con 0x7fbd8c0b1440 2024-08-17T02:50:15.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.357+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c138450 con 0x7fbd8c0b1440 2024-08-17T02:50:15.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.357+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80011ad0 con 0x7fbd8c0b1440 2024-08-17T02:50:15.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.357+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c138a10 con 0x7fbd8c0b1440 2024-08-17T02:50:15.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.358+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c064db0 con 0x7fbd8c0b1440 2024-08-17T02:50:15.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.358+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbd8001b3b0 con 0x7fbd8c0b1440 2024-08-17T02:50:15.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.360+0000 7fbd7fe00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbd6c065150 0x7fbd6c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.360+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbd80081750 con 0x7fbd8c0b1440 2024-08-17T02:50:15.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.360+0000 7fbd8be00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbd6c065150 0x7fbd6c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.360+0000 7fbd8be00640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbd6c065150 0x7fbd6c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.364+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd8004fab0 con 0x7fbd8c0b1440 2024-08-17T02:50:15.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.537+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd8c166c90 con 0x7fbd6c065150 2024-08-17T02:50:15.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.537+0000 7fbd7fe00640 1 -- 172.21.15.149:0/1307373612 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd7800fd30 con 0x7fbd6c065150 2024-08-17T02:50:15.539 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:50:15.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.539+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbd6c065150 msgr2=0x7fbd6c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.539+0000 7fbd93600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbd6c065150 0x7fbd6c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78008040 comp rx=0 tx=0).stop 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.539+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 msgr2=0x7fbd8c137b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.539+0000 7fbd93600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 0x7fbd8c137b40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c560 tx=0x7fbd80007ef0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 shutdown_connections 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fbd6c065150 0x7fbd6c067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd8c140580 0x7fbd8c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd8c1401b0 0x7fbd8c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.542 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 --2- 172.21.15.149:0/1307373612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0b1440 0x7fbd8c137b40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 >> 172.21.15.149:0/1307373612 conn(0x7fbd8c0cb9b0 msgr2=0x7fbd8c06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 shutdown_connections 2024-08-17T02:50:15.543 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.540+0000 7fbd93600640 1 -- 172.21.15.149:0/1307373612 wait complete. 2024-08-17T02:50:15.556 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:50:15.557 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:15.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.710+0000 7fc8c2000640 1 Processor -- start 2024-08-17T02:50:15.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.710+0000 7fc8c2000640 1 -- start start 2024-08-17T02:50:15.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8bc155880 0x7fc8bc0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c2000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc0aeb70 0x7fc8bc0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c2000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc157840 con 0x7fc8bc155c50 2024-08-17T02:50:15.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c2000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc156c30 con 0x7fc8bc155880 2024-08-17T02:50:15.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c2000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc156f10 con 0x7fc8bc0aeb70 2024-08-17T02:50:15.713 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8bc155880 0x7fc8bc0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8bc155880 0x7fc8bc0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34904/0 (socket says 172.21.15.149:34904) 2024-08-17T02:50:15.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 -- 172.21.15.149:0/3164931631 learned_addr learned my addr 172.21.15.149:0/3164931631 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c1600640 1 --1- 172.21.15.149:0/3164931631 >> v1:172.21.15.149:6789/0 conn(0x7fc8bc155c50 0x7fc8bc1596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33444/0 (socket says 172.21.15.149:33444) 2024-08-17T02:50:15.714 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8b3e00640 1 --2- 172.21.15.149:0/3164931631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc0aeb70 0x7fc8bc0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 -- 172.21.15.149:0/3164931631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc0aeb70 msgr2=0x7fc8bc0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 --2- 172.21.15.149:0/3164931631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc0aeb70 0x7fc8bc0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 -- 172.21.15.149:0/3164931631 >> v1:172.21.15.149:6789/0 conn(0x7fc8bc155c50 legacy=0x7fc8bc1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.712+0000 7fc8c0c00640 1 -- 172.21.15.149:0/3164931631 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc1571f0 con 0x7fc8bc155880 2024-08-17T02:50:15.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.713+0000 7fc8c0c00640 1 --2- 172.21.15.149:0/3164931631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155880 0x7fc8bc0ae630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009910 tx=0x7fc8ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0af525649d2d2ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.713+0000 7fc8bbe00640 1 -- 172.21.15.149:0/3164931631 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02ae40 con 0x7fc8bc155880 2024-08-17T02:50:15.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.713+0000 7fc8bbe00640 1 -- 172.21.15.149:0/3164931631 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac032440 con 0x7fc8bc155880 2024-08-17T02:50:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.713+0000 7fc8bbe00640 1 -- 172.21.15.149:0/3164931631 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac032820 con 0x7fc8bc155880 2024-08-17T02:50:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 -- 172.21.15.149:0/3164931631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155880 msgr2=0x7fc8bc0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 --2- 172.21.15.149:0/3164931631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155880 0x7fc8bc0ae630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009910 tx=0x7fc8ac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 -- 172.21.15.149:0/3164931631 shutdown_connections 2024-08-17T02:50:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 --2- 172.21.15.149:0/3164931631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc0aeb70 0x7fc8bc0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 --2- 172.21.15.149:0/3164931631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155880 0x7fc8bc0ae630 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 -- 172.21.15.149:0/3164931631 >> 172.21.15.149:0/3164931631 conn(0x7fc8bc067750 msgr2=0x7fc8bc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 -- 172.21.15.149:0/3164931631 shutdown_connections 2024-08-17T02:50:15.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.714+0000 7fc8c2000640 1 -- 172.21.15.149:0/3164931631 wait complete. 2024-08-17T02:50:15.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.715+0000 7fc8c2000640 1 Processor -- start 2024-08-17T02:50:15.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.715+0000 7fc8c2000640 1 -- start start 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.716+0000 7fc8c2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0aeb70 0x7fc8bc0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.716+0000 7fc8c2000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc155880 0x7fc8bc146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.716+0000 7fc8c2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155c50 0x7fc8bc160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.716+0000 7fc8c2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1605a0 con 0x7fc8bc155c50 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.716+0000 7fc8c2000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc15fce0 con 0x7fc8bc0aeb70 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.716+0000 7fc8c2000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc15ff50 con 0x7fc8bc155880 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155c50 0x7fc8bc160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155c50 0x7fc8bc160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34920/0 (socket says 172.21.15.149:34920) 2024-08-17T02:50:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 -- 172.21.15.149:0/453019816 learned_addr learned my addr 172.21.15.149:0/453019816 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8b3e00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc155880 0x7fc8bc146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c0c00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0aeb70 0x7fc8bc0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 -- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc155880 msgr2=0x7fc8bc146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc155880 0x7fc8bc146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 -- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0aeb70 msgr2=0x7fc8bc0a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8bc0aeb70 0x7fc8bc0a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 -- 172.21.15.149:0/453019816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009450 con 0x7fc8bc155c50 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8b3e00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8bc155880 0x7fc8bc146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8c1600640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155c50 0x7fc8bc160a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c870 tx=0x7fc8b40015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.717+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400ce60 con 0x7fc8bc155c50 2024-08-17T02:50:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.718+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4005d60 con 0x7fc8bc155c50 2024-08-17T02:50:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.718+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400a810 con 0x7fc8bc155c50 2024-08-17T02:50:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.718+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc160230 con 0x7fc8bc155c50 2024-08-17T02:50:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.718+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc146ff0 con 0x7fc8bc155c50 2024-08-17T02:50:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.718+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8bc071050 con 0x7fc8bc155c50 2024-08-17T02:50:15.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.719+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc8b400abc0 con 0x7fc8bc155c50 2024-08-17T02:50:15.725 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.720+0000 7fc8b8c00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc898065180 0x7fc898067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.720+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc8b4081df0 con 0x7fc8bc155c50 2024-08-17T02:50:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.720+0000 7fc8c0c00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc898065180 0x7fc898067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.720+0000 7fc8b8c00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc89806b070 0x7fc89806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.720+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 --> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc89806db30 con 0x7fc89806b070 2024-08-17T02:50:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.720+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b40842f0 con 0x7fc8bc155c50 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.721+0000 7fc8b3e00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc89806b070 0x7fc89806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.721+0000 7fc8c0c00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc898065180 0x7fc898067630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac034000 tx=0x7fc8ac032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.721+0000 7fc8b3e00640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc89806b070 0x7fc89806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.722+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== osd.3 v2:172.21.15.149:6808/37222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc89806db30 con 0x7fc89806b070 2024-08-17T02:50:15.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 --> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8bc14a970 con 0x7fc89806b070 2024-08-17T02:50:15.736 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8b8c00640 1 -- 172.21.15.149:0/453019816 <== osd.3 v2:172.21.15.149:6808/37222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc8bc14a970 con 0x7fc89806b070 2024-08-17T02:50:15.737 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:15.737 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:15.737 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:15.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc89806b070 msgr2=0x7fc89806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6808/37222,v1:172.21.15.149:6809/37222] conn(0x7fc89806b070 0x7fc89806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc898065180 msgr2=0x7fc898067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc898065180 0x7fc898067630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac034000 tx=0x7fc8ac032000 comp rx=0 tx=0).stop 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155c50 msgr2=0x7fc8bc160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 --2- 172.21.15.149:0/453019816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8bc155c50 0x7fc8bc160a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c870 tx=0x7fc8b40015f0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c1600640 1 -- 172.21.15.149:0/453019816 reap_dead start 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 shutdown_connections 2024-08-17T02:50:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.735+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 >> 172.21.15.149:0/453019816 conn(0x7fc8bc067750 msgr2=0x7fc8bc06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.736+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 shutdown_connections 2024-08-17T02:50:15.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.736+0000 7fc8c2000640 1 -- 172.21.15.149:0/453019816 wait complete. 2024-08-17T02:50:15.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:50:15.902 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.900+0000 7f6e2f200640 1 Processor -- start 2024-08-17T02:50:15.902 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.901+0000 7f6e2f200640 1 -- start start 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e2f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e28155a20 0x7f6e280adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e2f200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e28155df0 0x7f6e280ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e2f200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e28156670 con 0x7f6e2806d7f0 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e2f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e280b0350 con 0x7f6e28155a20 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e2f200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2806e5e0 con 0x7f6e28155df0 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e27e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e28155a20 0x7f6e280adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e27e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e28155a20 0x7f6e280adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34934/0 (socket says 172.21.15.149:34934) 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e27e00640 1 -- 172.21.15.149:0/2893820137 learned_addr learned my addr 172.21.15.149:0/2893820137 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.905 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e27e00640 1 -- 172.21.15.149:0/2893820137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e28155df0 msgr2=0x7f6e280ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.902+0000 7f6e1fe00640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e28155df0 0x7f6e280ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.903+0000 7f6e27e00640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e28155df0 0x7f6e280ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.903+0000 7f6e27e00640 1 -- 172.21.15.149:0/2893820137 >> v1:172.21.15.161:6789/0 conn(0x7f6e2806d7f0 legacy=0x7f6e280ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.903+0000 7f6e27e00640 1 -- 172.21.15.149:0/2893820137 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2806e8c0 con 0x7f6e28155a20 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.903+0000 7f6e1fe00640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e28155df0 0x7f6e280ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.904+0000 7f6e27e00640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155a20 0x7f6e280adf10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009910 tx=0x7f6e180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0cfae0ea250adc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.904+0000 7f6e27400640 1 -- 172.21.15.149:0/2893820137 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1802ae40 con 0x7f6e28155a20 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.904+0000 7f6e27400640 1 -- 172.21.15.149:0/2893820137 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e18032440 con 0x7f6e28155a20 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.904+0000 7f6e27400640 1 -- 172.21.15.149:0/2893820137 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18032820 con 0x7f6e28155a20 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.904+0000 7f6e2f200640 1 -- 172.21.15.149:0/2893820137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155a20 msgr2=0x7f6e280adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.904+0000 7f6e2f200640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155a20 0x7f6e280adf10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009910 tx=0x7f6e180091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.905+0000 7f6e2f200640 1 -- 172.21.15.149:0/2893820137 shutdown_connections 2024-08-17T02:50:15.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.905+0000 7f6e2f200640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e28155df0 0x7f6e280ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.905+0000 7f6e2f200640 1 --2- 172.21.15.149:0/2893820137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155a20 0x7f6e280adf10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.905+0000 7f6e2f200640 1 -- 172.21.15.149:0/2893820137 >> 172.21.15.149:0/2893820137 conn(0x7f6e280cb9b0 msgr2=0x7f6e280cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.905+0000 7f6e2f200640 1 -- 172.21.15.149:0/2893820137 shutdown_connections 2024-08-17T02:50:15.909 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.905+0000 7f6e2f200640 1 -- 172.21.15.149:0/2893820137 wait complete. 2024-08-17T02:50:15.909 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.906+0000 7f6e2f200640 1 Processor -- start 2024-08-17T02:50:15.909 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.906+0000 7f6e2f200640 1 -- start start 2024-08-17T02:50:15.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2f200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e2806d7f0 0x7f6e28148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 0x7f6e281490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2f200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2814a0c0 0x7f6e2814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e28149780 con 0x7f6e28155df0 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2f200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e281486c0 con 0x7f6e2814a0c0 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2f200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2814aa60 con 0x7f6e2806d7f0 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 0x7f6e281490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 0x7f6e281490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34944/0 (socket says 172.21.15.149:34944) 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 -- 172.21.15.149:0/1938479896 learned_addr learned my addr 172.21.15.149:0/1938479896 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e27e00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e2806d7f0 0x7f6e28148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 -- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e2806d7f0 msgr2=0x7f6e28148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e2806d7f0 0x7f6e28148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 -- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2814a0c0 msgr2=0x7f6e2814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2d200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2814a0c0 0x7f6e2814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2814a0c0 0x7f6e2814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 -- 172.21.15.149:0/1938479896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e18009450 con 0x7f6e28155df0 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e27e00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e2806d7f0 0x7f6e28148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e2d200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2814a0c0 0x7f6e2814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1fe00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 0x7f6e281490e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c8e0 tx=0x7f6e10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.908+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000ce70 con 0x7f6e28155df0 2024-08-17T02:50:15.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.909+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e100077d0 con 0x7f6e28155df0 2024-08-17T02:50:15.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.909+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10007b70 con 0x7f6e28155df0 2024-08-17T02:50:15.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.909+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e28147900 con 0x7f6e28155df0 2024-08-17T02:50:15.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.909+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e28147ec0 con 0x7f6e28155df0 2024-08-17T02:50:15.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.910+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28140810 con 0x7f6e28155df0 2024-08-17T02:50:15.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.910+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6e100113f0 con 0x7f6e28155df0 2024-08-17T02:50:15.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.911+0000 7f6e1f400640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e04065150 0x7f6e04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.911+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6e10082470 con 0x7f6e28155df0 2024-08-17T02:50:15.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.912+0000 7f6e27e00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e04065150 0x7f6e04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.912+0000 7f6e27e00640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e04065150 0x7f6e04067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e18032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:15.916+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6e28140810 con 0x7f6e28155df0 2024-08-17T02:50:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.087+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e28140810 con 0x7f6e04065150 2024-08-17T02:50:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.088+0000 7f6e1f400640 1 -- 172.21.15.149:0/1938479896 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6e28140810 con 0x7f6e04065150 2024-08-17T02:50:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:50:16.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e04065150 msgr2=0x7f6e04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e04065150 0x7f6e04067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e18032000 comp rx=0 tx=0).stop 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 msgr2=0x7f6e281490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 0x7f6e281490e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c8e0 tx=0x7f6e10008040 comp rx=0 tx=0).stop 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 shutdown_connections 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6e04065150 0x7f6e04067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2814a0c0 0x7f6e2814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e28155df0 0x7f6e281490e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 --2- 172.21.15.149:0/1938479896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e2806d7f0 0x7f6e28148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 >> 172.21.15.149:0/1938479896 conn(0x7f6e280cb9b0 msgr2=0x7f6e28156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 shutdown_connections 2024-08-17T02:50:16.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.090+0000 7f6e2f200640 1 -- 172.21.15.149:0/1938479896 wait complete. 2024-08-17T02:50:16.107 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:50:16.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:16.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.260+0000 7fc268c00640 1 Processor -- start 2024-08-17T02:50:16.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.261+0000 7fc268c00640 1 -- start start 2024-08-17T02:50:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc268c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2640b2ef0 0x7fc2640b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc268c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b0830 0x7fc2640b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc268c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640ad350 con 0x7fc264067de0 2024-08-17T02:50:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc268c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2640b1d20 con 0x7fc2640b2ef0 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc268c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b3800 con 0x7fc2640b0830 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc263e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc264067de0 0x7fc264068220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33446/0 (socket says 172.21.15.149:33446) 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc263e00640 1 -- 172.21.15.149:0/1636503258 learned_addr learned my addr 172.21.15.149:0/1636503258 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc25aa00640 1 --2- 172.21.15.149:0/1636503258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b0830 0x7fc2640b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.262+0000 7fc263400640 1 --2- 172.21.15.149:0/1636503258 >> v2:172.21.15.161:3300/0 conn(0x7fc2640b2ef0 0x7fc2640b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc262a00640 1 -- 172.21.15.149:0/1636503258 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290494730 0 0) 0x7fc2640ad350 con 0x7fc264067de0 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc262a00640 1 -- 172.21.15.149:0/1636503258 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2480034e0 con 0x7fc264067de0 2024-08-17T02:50:16.265 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc25aa00640 1 -- 172.21.15.149:0/1636503258 >> v2:172.21.15.161:3300/0 conn(0x7fc2640b2ef0 msgr2=0x7fc2640b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:16.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc25aa00640 1 --2- 172.21.15.149:0/1636503258 >> v2:172.21.15.161:3300/0 conn(0x7fc2640b2ef0 0x7fc2640b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc25aa00640 1 -- 172.21.15.149:0/1636503258 >> v1:172.21.15.149:6789/0 conn(0x7fc264067de0 legacy=0x7fc264068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc262a00640 1 -- 172.21.15.149:0/1636503258 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236142714 0 0) 0x7fc2480034e0 con 0x7fc264067de0 2024-08-17T02:50:16.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc25aa00640 1 -- 172.21.15.149:0/1636503258 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640b0cf0 con 0x7fc2640b0830 2024-08-17T02:50:16.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.263+0000 7fc263400640 1 --2- 172.21.15.149:0/1636503258 >> v2:172.21.15.161:3300/0 conn(0x7fc2640b2ef0 0x7fc2640b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:16.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.264+0000 7fc25aa00640 1 --2- 172.21.15.149:0/1636503258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b0830 0x7fc2640b1ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009850 tx=0x7fc24c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa263543dc510462 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.264+0000 7fc262a00640 1 -- 172.21.15.149:0/1636503258 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0017f0 con 0x7fc2640b0830 2024-08-17T02:50:16.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.264+0000 7fc262a00640 1 -- 172.21.15.149:0/1636503258 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c02aa50 con 0x7fc2640b0830 2024-08-17T02:50:16.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.264+0000 7fc262a00640 1 -- 172.21.15.149:0/1636503258 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c02add0 con 0x7fc2640b0830 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 -- 172.21.15.149:0/1636503258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b0830 msgr2=0x7fc2640b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 --2- 172.21.15.149:0/1636503258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b0830 0x7fc2640b1ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009850 tx=0x7fc24c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 -- 172.21.15.149:0/1636503258 shutdown_connections 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 --2- 172.21.15.149:0/1636503258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b0830 0x7fc2640b1ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 --2- 172.21.15.149:0/1636503258 >> v2:172.21.15.161:3300/0 conn(0x7fc2640b2ef0 0x7fc2640b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 -- 172.21.15.149:0/1636503258 >> 172.21.15.149:0/1636503258 conn(0x7fc264096a70 msgr2=0x7fc264096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 -- 172.21.15.149:0/1636503258 shutdown_connections 2024-08-17T02:50:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.265+0000 7fc268c00640 1 -- 172.21.15.149:0/1636503258 wait complete. 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.266+0000 7fc268c00640 1 Processor -- start 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.266+0000 7fc268c00640 1 -- start start 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.267+0000 7fc268c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc264067de0 0x7fc26414b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.267+0000 7fc268c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2640b0830 0x7fc2640af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.267+0000 7fc268c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b2ef0 0x7fc2640c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.267+0000 7fc268c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b02a0 con 0x7fc2640b0830 2024-08-17T02:50:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.267+0000 7fc268c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26409a370 con 0x7fc264067de0 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.267+0000 7fc268c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26414ba20 con 0x7fc2640b2ef0 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2640b0830 0x7fc2640af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2640b0830 0x7fc2640af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34956/0 (socket says 172.21.15.149:34956) 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 -- 172.21.15.149:0/532376632 learned_addr learned my addr 172.21.15.149:0/532376632 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc263400640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc264067de0 0x7fc26414b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc263e00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b2ef0 0x7fc2640c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 -- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b2ef0 msgr2=0x7fc2640c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2640b2ef0 0x7fc2640c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 -- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc264067de0 msgr2=0x7fc26414b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc264067de0 0x7fc26414b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 -- 172.21.15.149:0/532376632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009390 con 0x7fc2640b0830 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.268+0000 7fc25aa00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2640b0830 0x7fc2640af7e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009360 tx=0x7fc24c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.269+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c032e60 con 0x7fc2640b0830 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.269+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c03d420 con 0x7fc2640b0830 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.269+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c03d7e0 con 0x7fc2640b0830 2024-08-17T02:50:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.269+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c009390 con 0x7fc2640b0830 2024-08-17T02:50:16.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.269+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc264099d20 con 0x7fc2640b0830 2024-08-17T02:50:16.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.270+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc264063d20 con 0x7fc2640b0830 2024-08-17T02:50:16.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.270+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc24c039040 con 0x7fc2640b0830 2024-08-17T02:50:16.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.271+0000 7fc25b400640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc240065150 0x7fc240067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.271+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc24c0a1610 con 0x7fc2640b0830 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.271+0000 7fc263400640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc240065150 0x7fc240067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.271+0000 7fc25b400640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fc24006b040 0x7fc24006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.271+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 --> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc24006db00 con 0x7fc24006b040 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.271+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc24c0a3b70 con 0x7fc2640b0830 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.272+0000 7fc263e00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fc24006b040 0x7fc24006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.272+0000 7fc263400640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc240065150 0x7fc240067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2640ad460 tx=0x7fc2540090f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.272+0000 7fc263e00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fc24006b040 0x7fc24006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.276 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.273+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== osd.4 v2:172.21.15.161:6819/37094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc24006db00 con 0x7fc24006b040 2024-08-17T02:50:16.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.286+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 --> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc264071050 con 0x7fc24006b040 2024-08-17T02:50:16.288 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.287+0000 7fc25b400640 1 -- 172.21.15.149:0/532376632 <== osd.4 v2:172.21.15.161:6819/37094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc264071050 con 0x7fc24006b040 2024-08-17T02:50:16.288 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:16.289 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.287+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fc24006b040 msgr2=0x7fc24006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.287+0000 7fc268c00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.161:6819/37094,v1:172.21.15.161:6821/37094] conn(0x7fc24006b040 0x7fc24006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.287+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc240065150 msgr2=0x7fc240067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc240065150 0x7fc240067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2640ad460 tx=0x7fc2540090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2640b0830 msgr2=0x7fc2640af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 --2- 172.21.15.149:0/532376632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2640b0830 0x7fc2640af7e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009360 tx=0x7fc24c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:16.290 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc263e00640 1 -- 172.21.15.149:0/532376632 reap_dead start 2024-08-17T02:50:16.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 shutdown_connections 2024-08-17T02:50:16.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 >> 172.21.15.149:0/532376632 conn(0x7fc264096a70 msgr2=0x7fc26406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 shutdown_connections 2024-08-17T02:50:16.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.288+0000 7fc268c00640 1 -- 172.21.15.149:0/532376632 wait complete. 2024-08-17T02:50:16.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:50:16.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e6b000640 1 Processor -- start 2024-08-17T02:50:16.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e6b000640 1 -- start start 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e6b000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e6b000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640caa80 con 0x7f0e641401b0 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e6b000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640c9e70 con 0x7f0e640b1440 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e6b000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640c9c90 con 0x7f0e64140580 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.453+0000 7f0e63e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0e641401b0 0x7f0e640b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33456/0 (socket says 172.21.15.149:33456) 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e63e00640 1 -- 172.21.15.149:0/1856287613 learned_addr learned my addr 172.21.15.149:0/1856287613 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e69000640 1 --2- 172.21.15.149:0/1856287613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434707220 0 0) 0x7f0e640caa80 con 0x7f0e641401b0 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e480034e0 con 0x7f0e641401b0 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444887720 0 0) 0x7f0e640c9e70 con 0x7f0e640b1440 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e640caa80 con 0x7f0e640b1440 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e69000640 1 -- 172.21.15.149:0/1856287613 >> v1:172.21.15.161:6789/0 conn(0x7f0e640b1440 legacy=0x7f0e640c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e69000640 1 -- 172.21.15.149:0/1856287613 >> v1:172.21.15.149:6789/0 conn(0x7f0e641401b0 legacy=0x7f0e640b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3324676155 0 0) 0x7f0e480034e0 con 0x7f0e641401b0 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.454+0000 7f0e69000640 1 -- 172.21.15.149:0/1856287613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640ca150 con 0x7f0e64140580 2024-08-17T02:50:16.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.455+0000 7f0e69000640 1 --2- 172.21.15.149:0/1856287613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c9750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009e90 tx=0x7f0e5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c326e105ce6634c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.458 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54001470 con 0x7f0e64140580 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c02d050 con 0x7f0e64140580 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e63400640 1 -- 172.21.15.149:0/1856287613 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c031630 con 0x7f0e64140580 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 -- 172.21.15.149:0/1856287613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 msgr2=0x7f0e640c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 --2- 172.21.15.149:0/1856287613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c9750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009e90 tx=0x7f0e5c009780 comp rx=0 tx=0).stop 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 -- 172.21.15.149:0/1856287613 shutdown_connections 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 --2- 172.21.15.149:0/1856287613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c9750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 -- 172.21.15.149:0/1856287613 >> 172.21.15.149:0/1856287613 conn(0x7f0e640cb9b0 msgr2=0x7f0e640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 -- 172.21.15.149:0/1856287613 shutdown_connections 2024-08-17T02:50:16.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.456+0000 7f0e6b000640 1 -- 172.21.15.149:0/1856287613 wait complete. 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.458+0000 7f0e6b000640 1 Processor -- start 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.458+0000 7f0e6b000640 1 -- start start 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e6b000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e640b1440 0x7f0e6413a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e6b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 0x7f0e640c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e6b000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e6b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6413a930 con 0x7f0e641401b0 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e6b000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640c6260 con 0x7f0e640b1440 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e6b000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640c6540 con 0x7f0e64140580 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e5b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 0x7f0e640c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e5b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 0x7f0e640c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34958/0 (socket says 172.21.15.149:34958) 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e5b400640 1 -- 172.21.15.149:0/3378924472 learned_addr learned my addr 172.21.15.149:0/3378924472 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e63e00640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e640b1440 0x7f0e6413a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.459+0000 7f0e69000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5b400640 1 -- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 msgr2=0x7f0e640c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5b400640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5b400640 1 -- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e640b1440 msgr2=0x7f0e6413a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5b400640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e640b1440 0x7f0e6413a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5b400640 1 -- 172.21.15.149:0/3378924472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c009a20 con 0x7f0e641401b0 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5b400640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 0x7f0e640c5760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c590 tx=0x7f0e4c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c012630 con 0x7f0e641401b0 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0127b0 con 0x7f0e641401b0 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c012bb0 con 0x7f0e641401b0 2024-08-17T02:50:16.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6413ad80 con 0x7f0e641401b0 2024-08-17T02:50:16.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.460+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6413b340 con 0x7f0e641401b0 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.461+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6413b560 con 0x7f0e641401b0 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.462+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e4c01a3b0 con 0x7f0e641401b0 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.463+0000 7f0e5be00640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e40065150 0x7f0e40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.463+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0e4c081ff0 con 0x7f0e641401b0 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.463+0000 7f0e63e00640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e40065150 0x7f0e40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.464+0000 7f0e63e00640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e40065150 0x7f0e40067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e540015a0 tx=0x7f0e54001b00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.467+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e4c050380 con 0x7f0e641401b0 2024-08-17T02:50:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.638+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e64064db0 con 0x7f0e40065150 2024-08-17T02:50:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.639+0000 7f0e5be00640 1 -- 172.21.15.149:0/3378924472 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e64064db0 con 0x7f0e40065150 2024-08-17T02:50:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e40065150 msgr2=0x7f0e40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e40065150 0x7f0e40067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e540015a0 tx=0x7f0e54001b00 comp rx=0 tx=0).stop 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 msgr2=0x7f0e640c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 0x7f0e640c5760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c590 tx=0x7f0e4c007d80 comp rx=0 tx=0).stop 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 shutdown_connections 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e40065150 0x7f0e40067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e64140580 0x7f0e640c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.643 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e641401b0 0x7f0e640c5760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 --2- 172.21.15.149:0/3378924472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e640b1440 0x7f0e6413a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 >> 172.21.15.149:0/3378924472 conn(0x7f0e640cb9b0 msgr2=0x7f0e6413ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 shutdown_connections 2024-08-17T02:50:16.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.641+0000 7f0e6b000640 1 -- 172.21.15.149:0/3378924472 wait complete. 2024-08-17T02:50:16.657 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:50:16.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.809+0000 7f4fee800640 1 Processor -- start 2024-08-17T02:50:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.809+0000 7f4fee800640 1 -- start start 2024-08-17T02:50:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fee800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4fe8156890 0x7f4fe806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fee800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe80ae9b0 con 0x7f4fe8156c60 2024-08-17T02:50:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fee800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe80ab320 con 0x7f4fe80c8840 2024-08-17T02:50:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fee800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80aa730 con 0x7f4fe8156890 2024-08-17T02:50:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fdea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4fe8156c60 0x7f4fe80c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33468/0 (socket says 172.21.15.149:33468) 2024-08-17T02:50:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fdea00640 1 -- 172.21.15.149:0/1140464842 learned_addr learned my addr 172.21.15.149:0/1140464842 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe7400640 1 --2- 172.21.15.149:0/1140464842 >> v2:172.21.15.161:3300/0 conn(0x7f4fe8156890 0x7f4fe806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955700409 0 0) 0x7f4fe80ae9b0 con 0x7f4fe8156c60 2024-08-17T02:50:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fcc0034e0 con 0x7f4fe8156c60 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470955349 0 0) 0x7f4fe80ab320 con 0x7f4fe80c8840 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe80ae9b0 con 0x7f4fe80c8840 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe7400640 1 -- 172.21.15.149:0/1140464842 >> v1:172.21.15.161:6789/0 conn(0x7f4fe80c8840 legacy=0x7f4fe80ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe7400640 1 -- 172.21.15.149:0/1140464842 >> v1:172.21.15.149:6789/0 conn(0x7f4fe8156c60 legacy=0x7f4fe80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.811+0000 7f4fe7400640 1 -- 172.21.15.149:0/1140464842 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe80aa9f0 con 0x7f4fe8156890 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.812+0000 7f4fe7400640 1 --2- 172.21.15.149:0/1140464842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806dee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009850 tx=0x7f4fd80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2541f9f207f9bf78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.812+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd802ad90 con 0x7f4fe8156890 2024-08-17T02:50:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.812+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd8032440 con 0x7f4fe8156890 2024-08-17T02:50:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.812+0000 7f4fe6a00640 1 -- 172.21.15.149:0/1140464842 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80327e0 con 0x7f4fe8156890 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.812+0000 7f4fee800640 1 -- 172.21.15.149:0/1140464842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 msgr2=0x7f4fe806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.812+0000 7f4fee800640 1 --2- 172.21.15.149:0/1140464842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806dee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009850 tx=0x7f4fd80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.813+0000 7f4fee800640 1 -- 172.21.15.149:0/1140464842 shutdown_connections 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.813+0000 7f4fee800640 1 --2- 172.21.15.149:0/1140464842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806dee0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.813+0000 7f4fee800640 1 -- 172.21.15.149:0/1140464842 >> 172.21.15.149:0/1140464842 conn(0x7f4fe8067750 msgr2=0x7f4fe806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.813+0000 7f4fee800640 1 -- 172.21.15.149:0/1140464842 shutdown_connections 2024-08-17T02:50:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.813+0000 7f4fee800640 1 -- 172.21.15.149:0/1140464842 wait complete. 2024-08-17T02:50:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.814+0000 7f4fee800640 1 Processor -- start 2024-08-17T02:50:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.814+0000 7f4fee800640 1 -- start start 2024-08-17T02:50:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fee800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe80c8840 0x7f4fe814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fee800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fee800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe8156c60 0x7f4fe806d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fee800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8155960 con 0x7f4fe8156c60 2024-08-17T02:50:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fee800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8159610 con 0x7f4fe8156890 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fee800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8154380 con 0x7f4fe80c8840 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fe7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe8156c60 0x7f4fe806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fe7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe8156c60 0x7f4fe806d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34966/0 (socket says 172.21.15.149:34966) 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.815+0000 7f4fe7e00640 1 -- 172.21.15.149:0/1745996884 learned_addr learned my addr 172.21.15.149:0/1745996884 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7400640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe80c8840 0x7f4fe814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7e00640 1 -- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe80c8840 msgr2=0x7f4fe814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fdea00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7e00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe80c8840 0x7f4fe814ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7e00640 1 -- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 msgr2=0x7f4fe806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7e00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7e00640 1 -- 172.21.15.149:0/1745996884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8009390 con 0x7f4fe8156c60 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7400640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fe80c8840 0x7f4fe814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fdea00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fe8156890 0x7f4fe806cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fe7e00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe8156c60 0x7f4fe806d010 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c940 tx=0x7f4fe00026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000a850 con 0x7f4fe8156c60 2024-08-17T02:50:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000a9d0 con 0x7f4fe8156c60 2024-08-17T02:50:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000ad90 con 0x7f4fe8156c60 2024-08-17T02:50:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe8154660 con 0x7f4fe8156c60 2024-08-17T02:50:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.816+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe8154c20 con 0x7f4fe8156c60 2024-08-17T02:50:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.817+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fe80710c0 con 0x7f4fe8156c60 2024-08-17T02:50:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.818+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4fe0012630 con 0x7f4fe8156c60 2024-08-17T02:50:16.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.819+0000 7f4fdf400640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.819+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4fe00825c0 con 0x7f4fe8156c60 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.819+0000 7f4fe7400640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.819+0000 7f4fdf400640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f4fc406b040 0x7f4fc406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.819+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 --> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fc406db00 con 0x7f4fc406b040 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.819+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fe0084ac0 con 0x7f4fe8156c60 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.820+0000 7f4fdea00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f4fc406b040 0x7f4fc406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.820+0000 7f4fe7400640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8034000 tx=0x7f4fd8032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.820+0000 7f4fdea00640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f4fc406b040 0x7f4fc406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.821+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== osd.5 v2:172.21.15.161:6808/37093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4fc406db00 con 0x7f4fc406b040 2024-08-17T02:50:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.835+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 --> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4fe815c540 con 0x7f4fc406b040 2024-08-17T02:50:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fdf400640 1 -- 172.21.15.149:0/1745996884 <== osd.5 v2:172.21.15.161:6808/37093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4fe815c540 con 0x7f4fc406b040 2024-08-17T02:50:16.837 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:16.837 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:16.837 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f4fc406b040 msgr2=0x7f4fc406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.161:6808/37093,v1:172.21.15.161:6809/37093] conn(0x7f4fc406b040 0x7f4fc406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 msgr2=0x7f4fc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f4fc4065150 0x7f4fc4067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8034000 tx=0x7f4fd8032000 comp rx=0 tx=0).stop 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe8156c60 msgr2=0x7f4fe806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 --2- 172.21.15.149:0/1745996884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fe8156c60 0x7f4fe806d010 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c940 tx=0x7f4fe00026f0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fe7e00640 1 -- 172.21.15.149:0/1745996884 reap_dead start 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 shutdown_connections 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 >> 172.21.15.149:0/1745996884 conn(0x7f4fe8067750 msgr2=0x7f4fe80aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 shutdown_connections 2024-08-17T02:50:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:16.836+0000 7f4fee800640 1 -- 172.21.15.149:0/1745996884 wait complete. 2024-08-17T02:50:16.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:50:17.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.002+0000 7f5aa8400640 1 Processor -- start 2024-08-17T02:50:17.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.002+0000 7f5aa8400640 1 -- start start 2024-08-17T02:50:17.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.003+0000 7f5aa8400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5aa006e790 0x7f5aa00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.003+0000 7f5aa8400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa00afc10 con 0x7f5aa0155180 2024-08-17T02:50:17.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa8400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa00af000 con 0x7f5aa0155550 2024-08-17T02:50:17.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa8400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa00af2e0 con 0x7f5aa006e790 2024-08-17T02:50:17.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa5a00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5aa0155180 0x7f5aa00ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42084/0 (socket says 172.21.15.149:42084) 2024-08-17T02:50:17.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa5a00640 1 -- 172.21.15.149:0/1848463474 learned_addr learned my addr 172.21.15.149:0/1848463474 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:17.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa6400640 1 --2- 172.21.15.149:0/1848463474 >> v2:172.21.15.149:3300/0 conn(0x7f5aa006e790 0x7f5aa00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa6400640 1 -- 172.21.15.149:0/1848463474 >> v1:172.21.15.161:6789/0 conn(0x7f5aa0155550 legacy=0x7f5aa006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa6400640 1 -- 172.21.15.149:0/1848463474 >> v1:172.21.15.149:6789/0 conn(0x7f5aa0155180 legacy=0x7f5aa00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5a9fe00640 1 -- 172.21.15.149:0/1848463474 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491505968 0 0) 0x7f5aa00afc10 con 0x7f5aa0155180 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.004+0000 7f5aa6400640 1 -- 172.21.15.149:0/1848463474 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00af5c0 con 0x7f5aa006e790 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.005+0000 7f5aa6400640 1 --2- 172.21.15.149:0/1848463474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa006e790 0x7f5aa00aea20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800af70 tx=0x7f5a9800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70546807a9a3a422 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5a9fe00640 1 -- 172.21.15.149:0/1848463474 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9800a2e0 con 0x7f5aa006e790 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5a9fe00640 1 -- 172.21.15.149:0/1848463474 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98008450 con 0x7f5aa006e790 2024-08-17T02:50:17.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5a9fe00640 1 -- 172.21.15.149:0/1848463474 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980087f0 con 0x7f5aa006e790 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 -- 172.21.15.149:0/1848463474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa006e790 msgr2=0x7f5aa00aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 --2- 172.21.15.149:0/1848463474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa006e790 0x7f5aa00aea20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800af70 tx=0x7f5a9800a890 comp rx=0 tx=0).stop 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 -- 172.21.15.149:0/1848463474 shutdown_connections 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 --2- 172.21.15.149:0/1848463474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa006e790 0x7f5aa00aea20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 -- 172.21.15.149:0/1848463474 >> 172.21.15.149:0/1848463474 conn(0x7f5aa00cb9b0 msgr2=0x7f5aa00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 -- 172.21.15.149:0/1848463474 shutdown_connections 2024-08-17T02:50:17.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.006+0000 7f5aa8400640 1 -- 172.21.15.149:0/1848463474 wait complete. 2024-08-17T02:50:17.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.008+0000 7f5aa8400640 1 Processor -- start 2024-08-17T02:50:17.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.008+0000 7f5aa8400640 1 -- start start 2024-08-17T02:50:17.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.008+0000 7f5aa8400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa006e790 0x7f5aa01440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 0x7f5aa00c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa8400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa0155550 0x7f5aa00695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.011 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00c4920 con 0x7f5aa0155180 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa8400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0168200 con 0x7f5aa006e790 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa8400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00c4360 con 0x7f5aa0155550 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 0x7f5aa00c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 0x7f5aa00c3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42312/0 (socket says 172.21.15.149:42312) 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 -- 172.21.15.149:0/32548359 learned_addr learned my addr 172.21.15.149:0/32548359 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5a00640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa006e790 0x7f5aa01440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa6400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa0155550 0x7f5aa00695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 -- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa0155550 msgr2=0x7f5aa00695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.012 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa0155550 0x7f5aa00695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 -- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa006e790 msgr2=0x7f5aa01440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa006e790 0x7f5aa01440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 -- 172.21.15.149:0/32548359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9800ab30 con 0x7f5aa0155180 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5a00640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa006e790 0x7f5aa01440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.009+0000 7f5aa5000640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 0x7f5aa00c3980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00b4f0 tx=0x7f5a8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.010+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00f510 con 0x7f5aa0155180 2024-08-17T02:50:17.013 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.010+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c00f670 con 0x7f5aa0155180 2024-08-17T02:50:17.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.010+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00fa30 con 0x7f5aa0155180 2024-08-17T02:50:17.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.010+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa00c4640 con 0x7f5aa0155180 2024-08-17T02:50:17.014 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.010+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa00a5620 con 0x7f5aa0155180 2024-08-17T02:50:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.011+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa0064db0 con 0x7f5aa0155180 2024-08-17T02:50:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.012+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5a8c01a400 con 0x7f5aa0155180 2024-08-17T02:50:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.012+0000 7f5a9cc00640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a80065150 0x7f5a80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.013+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5a8c081cd0 con 0x7f5aa0155180 2024-08-17T02:50:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.013+0000 7f5aa5a00640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a80065150 0x7f5a80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.013+0000 7f5aa5a00640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a80065150 0x7f5a80067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00b0510 tx=0x7f5a94009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.017 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.017+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5a8c0500b0 con 0x7f5aa0155180 2024-08-17T02:50:17.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.190+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f5aa00c8280 con 0x7f5a80065150 2024-08-17T02:50:17.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.190+0000 7f5a9cc00640 1 -- 172.21.15.149:0/32548359 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5aa00c8280 con 0x7f5a80065150 2024-08-17T02:50:17.191 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:50:17.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a80065150 msgr2=0x7f5a80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a80065150 0x7f5a80067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00b0510 tx=0x7f5a94009040 comp rx=0 tx=0).stop 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 msgr2=0x7f5aa00c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 0x7f5aa00c3980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00b4f0 tx=0x7f5a8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 shutdown_connections 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f5a80065150 0x7f5a80067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa0155550 0x7f5aa00695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa0155180 0x7f5aa00c3980 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 --2- 172.21.15.149:0/32548359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa006e790 0x7f5aa01440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 >> 172.21.15.149:0/32548359 conn(0x7f5aa00cb9b0 msgr2=0x7f5aa00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 shutdown_connections 2024-08-17T02:50:17.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.193+0000 7f5aa8400640 1 -- 172.21.15.149:0/32548359 wait complete. 2024-08-17T02:50:17.208 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:50:17.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.359+0000 7f0007e00640 1 Processor -- start 2024-08-17T02:50:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.360+0000 7f0007e00640 1 -- start start 2024-08-17T02:50:17.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0007e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0008155880 0x7f00080ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0007e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080af800 0x7f0008157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0007e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0008157840 con 0x7f00080aeb70 2024-08-17T02:50:17.362 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0007e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0008156c30 con 0x7f0008155880 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0007e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0008156f10 con 0x7f00080af800 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0006a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0008155880 0x7f00080ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0006000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f00080aeb70 0x7f00080af0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42096/0 (socket says 172.21.15.149:42096) 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.361+0000 7f0006000640 1 -- 172.21.15.149:0/1928122857 learned_addr learned my addr 172.21.15.149:0/1928122857 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.362+0000 7f0007400640 1 --2- 172.21.15.149:0/1928122857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080af800 0x7f0008157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.362+0000 7f0006a00640 1 -- 172.21.15.149:0/1928122857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080af800 msgr2=0x7f0008157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.362+0000 7f0006a00640 1 --2- 172.21.15.149:0/1928122857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080af800 0x7f0008157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.362+0000 7f0006a00640 1 -- 172.21.15.149:0/1928122857 >> v1:172.21.15.149:6789/0 conn(0x7f00080aeb70 legacy=0x7f00080af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.362+0000 7f0006a00640 1 -- 172.21.15.149:0/1928122857 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00081571f0 con 0x7f0008155880 2024-08-17T02:50:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.362+0000 7f0005600640 1 -- 172.21.15.149:0/1928122857 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238529844 0 0) 0x7f0008157840 con 0x7f00080aeb70 2024-08-17T02:50:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.363+0000 7f0006a00640 1 --2- 172.21.15.149:0/1928122857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008155880 0x7f00080ae630 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efff8009850 tx=0x7efff80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb520dd3c30ade1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.363+0000 7f0005600640 1 -- 172.21.15.149:0/1928122857 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff802ad90 con 0x7f0008155880 2024-08-17T02:50:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.363+0000 7f0005600640 1 -- 172.21.15.149:0/1928122857 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8032440 con 0x7f0008155880 2024-08-17T02:50:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.363+0000 7f0005600640 1 -- 172.21.15.149:0/1928122857 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80327e0 con 0x7f0008155880 2024-08-17T02:50:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 -- 172.21.15.149:0/1928122857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008155880 msgr2=0x7f00080ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 --2- 172.21.15.149:0/1928122857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008155880 0x7f00080ae630 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efff8009850 tx=0x7efff80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 -- 172.21.15.149:0/1928122857 shutdown_connections 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 --2- 172.21.15.149:0/1928122857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080af800 0x7f0008157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 --2- 172.21.15.149:0/1928122857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008155880 0x7f00080ae630 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 -- 172.21.15.149:0/1928122857 >> 172.21.15.149:0/1928122857 conn(0x7f0008067750 msgr2=0x7f00080cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 -- 172.21.15.149:0/1928122857 shutdown_connections 2024-08-17T02:50:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.364+0000 7f0007e00640 1 -- 172.21.15.149:0/1928122857 wait complete. 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.365+0000 7f0007e00640 1 Processor -- start 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.365+0000 7f0007e00640 1 -- start start 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0007e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080aeb70 0x7f000813e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0007e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00080af800 0x7f0008154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0007e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0008155880 0x7f000813dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0007e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008140b20 con 0x7f00080af800 2024-08-17T02:50:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0007e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008168070 con 0x7f0008155880 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0007e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0008141600 con 0x7f00080aeb70 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0006000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00080af800 0x7f0008154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0006000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00080af800 0x7f0008154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42338/0 (socket says 172.21.15.149:42338) 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.366+0000 7f0006000640 1 -- 172.21.15.149:0/3853970960 learned_addr learned my addr 172.21.15.149:0/3853970960 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006a00640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080aeb70 0x7f000813e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0007400640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0008155880 0x7f000813dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006000640 1 -- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080aeb70 msgr2=0x7f000813e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006000640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00080aeb70 0x7f000813e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006000640 1 -- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0008155880 msgr2=0x7f000813dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006000640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0008155880 0x7f000813dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006000640 1 -- 172.21.15.149:0/3853970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009390 con 0x7f00080af800 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0006000640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00080af800 0x7f0008154280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efff400c540 tx=0x7efff400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4005aa0 con 0x7f00080af800 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4005c00 con 0x7f00080af800 2024-08-17T02:50:17.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40070f0 con 0x7f00080af800 2024-08-17T02:50:17.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.367+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0008140d10 con 0x7f00080af800 2024-08-17T02:50:17.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.368+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0008140fb0 con 0x7f00080af800 2024-08-17T02:50:17.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.368+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0008071050 con 0x7f00080af800 2024-08-17T02:50:17.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.369+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efff4007520 con 0x7f00080af800 2024-08-17T02:50:17.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.370+0000 7efffe000640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7effe8065150 0x7effe8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.370+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efff4081c20 con 0x7f00080af800 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.370+0000 7f0006a00640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7effe8065150 0x7effe8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.370+0000 7efffe000640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7effe806b040 0x7effe806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.370+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 --> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effe806db00 con 0x7effe806b040 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.370+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff4084260 con 0x7f00080af800 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.371+0000 7f0007400640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7effe806b040 0x7effe806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.371+0000 7f0006a00640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7effe8065150 0x7effe8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efff8034000 tx=0x7efff8032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.372+0000 7f0007400640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7effe806b040 0x7effe806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.375 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.372+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== osd.6 v2:172.21.15.161:6800/37092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7effe806db00 con 0x7effe806b040 2024-08-17T02:50:17.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.385+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 --> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00080cc150 con 0x7effe806b040 2024-08-17T02:50:17.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7efffe000640 1 -- 172.21.15.149:0/3853970960 <== osd.6 v2:172.21.15.161:6800/37092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00080cc150 con 0x7effe806b040 2024-08-17T02:50:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:17.386 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:17.387 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7effe806b040 msgr2=0x7effe806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.161:6800/37092,v1:172.21.15.161:6801/37092] conn(0x7effe806b040 0x7effe806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7effe8065150 msgr2=0x7effe8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7effe8065150 0x7effe8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efff8034000 tx=0x7efff8032000 comp rx=0 tx=0).stop 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00080af800 msgr2=0x7f0008154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 --2- 172.21.15.149:0/3853970960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00080af800 0x7f0008154280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efff400c540 tx=0x7efff400c940 comp rx=0 tx=0).stop 2024-08-17T02:50:17.388 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007400640 1 -- 172.21.15.149:0/3853970960 reap_dead start 2024-08-17T02:50:17.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 shutdown_connections 2024-08-17T02:50:17.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 >> 172.21.15.149:0/3853970960 conn(0x7f0008067750 msgr2=0x7f000814a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 shutdown_connections 2024-08-17T02:50:17.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.386+0000 7f0007e00640 1 -- 172.21.15.149:0/3853970960 wait complete. 2024-08-17T02:50:17.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:50:17.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.551+0000 7f6f51200640 1 Processor -- start 2024-08-17T02:50:17.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.552+0000 7f6f51200640 1 -- start start 2024-08-17T02:50:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f51200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f51200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f4c156ea0 0x7f6f4c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f51200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f4c06dab0 0x7f6f4c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f51200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c06e450 con 0x7f6f4c06dab0 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f51200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c0ca900 con 0x7f6f4c156ea0 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f51200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0cc560 con 0x7f6f4c156ad0 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f4c06dab0 0x7f6f4c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f4c06dab0 0x7f6f4c06df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42346/0 (socket says 172.21.15.149:42346) 2024-08-17T02:50:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4be00640 1 -- 172.21.15.149:0/2857598494 learned_addr learned my addr 172.21.15.149:0/2857598494 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:17.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4b400640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.556 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4be00640 1 -- 172.21.15.149:0/2857598494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 msgr2=0x7f6f4c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4be00640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f4be00640 1 -- 172.21.15.149:0/2857598494 >> v2:172.21.15.161:3300/0 conn(0x7f6f4c156ea0 msgr2=0x7f6f4c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.553+0000 7f6f43e00640 1 --2- 172.21.15.149:0/2857598494 >> v2:172.21.15.161:3300/0 conn(0x7f6f4c156ea0 0x7f6f4c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.554+0000 7f6f4be00640 1 --2- 172.21.15.149:0/2857598494 >> v2:172.21.15.161:3300/0 conn(0x7f6f4c156ea0 0x7f6f4c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.554+0000 7f6f4be00640 1 -- 172.21.15.149:0/2857598494 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0caaf0 con 0x7f6f4c06dab0 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.554+0000 7f6f4b400640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.554+0000 7f6f43e00640 1 --2- 172.21.15.149:0/2857598494 >> v2:172.21.15.161:3300/0 conn(0x7f6f4c156ea0 0x7f6f4c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.554+0000 7f6f4be00640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c06df10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c064670 tx=0x7f6f44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4be47f03dd3f5ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f4aa00640 1 -- 172.21.15.149:0/2857598494 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44007400 con 0x7f6f4c06dab0 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f4aa00640 1 -- 172.21.15.149:0/2857598494 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44007560 con 0x7f6f4c06dab0 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f4aa00640 1 -- 172.21.15.149:0/2857598494 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44007900 con 0x7f6f4c06dab0 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 -- 172.21.15.149:0/2857598494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c06dab0 msgr2=0x7f6f4c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c06df10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c064670 tx=0x7f6f44009840 comp rx=0 tx=0).stop 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 -- 172.21.15.149:0/2857598494 shutdown_connections 2024-08-17T02:50:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c06df10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 --2- 172.21.15.149:0/2857598494 >> v2:172.21.15.161:3300/0 conn(0x7f6f4c156ea0 0x7f6f4c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 --2- 172.21.15.149:0/2857598494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 -- 172.21.15.149:0/2857598494 >> 172.21.15.149:0/2857598494 conn(0x7f6f4c067750 msgr2=0x7f6f4c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.555+0000 7f6f51200640 1 -- 172.21.15.149:0/2857598494 shutdown_connections 2024-08-17T02:50:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.556+0000 7f6f51200640 1 -- 172.21.15.149:0/2857598494 wait complete. 2024-08-17T02:50:17.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.557+0000 7f6f51200640 1 Processor -- start 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.557+0000 7f6f51200640 1 -- start start 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f51200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c0c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f51200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f51200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 0x7f6f4c169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f51200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1523e0 con 0x7f6f4c156ea0 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f51200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c151ab0 con 0x7f6f4c06dab0 2024-08-17T02:50:17.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f51200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c151d90 con 0x7f6f4c156ad0 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f4be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 0x7f6f4c169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f4be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 0x7f6f4c169fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42362/0 (socket says 172.21.15.149:42362) 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f4be00640 1 -- 172.21.15.149:0/920909479 learned_addr learned my addr 172.21.15.149:0/920909479 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f43e00640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.558+0000 7f6f4b400640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c0c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f4be00640 1 -- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 msgr2=0x7f6f4c14c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f4be00640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c14c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f4be00640 1 -- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f4c06dab0 msgr2=0x7f6f4c0c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f4be00640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c0c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f4be00640 1 -- 172.21.15.149:0/920909479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009ae0 con 0x7f6f4c156ea0 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f4be00640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 0x7f6f4c169fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009ea0 tx=0x7f6f44034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44032e30 con 0x7f6f4c156ea0 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4403d430 con 0x7f6f4c156ea0 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4403d7d0 con 0x7f6f4c156ea0 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.559+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c152070 con 0x7f6f4c156ea0 2024-08-17T02:50:17.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.560+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c0c0b70 con 0x7f6f4c156ea0 2024-08-17T02:50:17.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.561+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c152850 con 0x7f6f4c156ea0 2024-08-17T02:50:17.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.561+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f4403c3d0 con 0x7f6f4c156ea0 2024-08-17T02:50:17.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.562+0000 7f6f42a00640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6f28065150 0x7f6f28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.562+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6f440a33e0 con 0x7f6f4c156ea0 2024-08-17T02:50:17.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.562+0000 7f6f4b400640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6f28065150 0x7f6f28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.563+0000 7f6f4b400640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6f28065150 0x7f6f28067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c006fd0 tx=0x7f6f3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.566+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f44071750 con 0x7f6f4c156ea0 2024-08-17T02:50:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.741+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f4c151c20 con 0x7f6f28065150 2024-08-17T02:50:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.742+0000 7f6f42a00640 1 -- 172.21.15.149:0/920909479 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6f4c151c20 con 0x7f6f28065150 2024-08-17T02:50:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6f28065150 msgr2=0x7f6f28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6f28065150 0x7f6f28067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c006fd0 tx=0x7f6f3c008040 comp rx=0 tx=0).stop 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 msgr2=0x7f6f4c169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 0x7f6f4c169fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009ea0 tx=0x7f6f44034000 comp rx=0 tx=0).stop 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 shutdown_connections 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f6f28065150 0x7f6f28067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4c156ea0 0x7f6f4c169fe0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f4c156ad0 0x7f6f4c14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 --2- 172.21.15.149:0/920909479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f4c06dab0 0x7f6f4c0c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 >> 172.21.15.149:0/920909479 conn(0x7f6f4c067750 msgr2=0x7f6f4c0687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 shutdown_connections 2024-08-17T02:50:17.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.744+0000 7f6f51200640 1 -- 172.21.15.149:0/920909479 wait complete. 2024-08-17T02:50:17.759 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:50:17.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:17.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.914+0000 7fafea200640 1 Processor -- start 2024-08-17T02:50:17.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.914+0000 7fafea200640 1 -- start start 2024-08-17T02:50:17.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafea200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fafe40b2bb0 0x7fafe40b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafea200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40b5740 0x7fafe415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafea200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe40d0a80 con 0x7fafe415c2e0 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafea200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe40b2130 con 0x7fafe40b2bb0 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafea200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe415c720 con 0x7fafe40b5740 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafe8e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fafe40b2bb0 0x7fafe40b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafe8e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fafe40b2bb0 0x7fafe40b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42378/0 (socket says 172.21.15.149:42378) 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.915+0000 7fafe8e00640 1 -- 172.21.15.149:0/1722918201 learned_addr learned my addr 172.21.15.149:0/1722918201 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:17.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.916+0000 7fafe3e00640 1 --2- 172.21.15.149:0/1722918201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40b5740 0x7fafe415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.916+0000 7fafe8e00640 1 -- 172.21.15.149:0/1722918201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40b5740 msgr2=0x7fafe415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:17.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.916+0000 7fafe8e00640 1 --2- 172.21.15.149:0/1722918201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40b5740 0x7fafe415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.916+0000 7fafe8e00640 1 -- 172.21.15.149:0/1722918201 >> v1:172.21.15.161:6789/0 conn(0x7fafe415c2e0 legacy=0x7fafe40b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.916+0000 7fafe8e00640 1 -- 172.21.15.149:0/1722918201 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40b23f0 con 0x7fafe40b2bb0 2024-08-17T02:50:17.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.917+0000 7fafe8e00640 1 --2- 172.21.15.149:0/1722918201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe40b2f80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009910 tx=0x7fafd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc082b4928863fe0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.917+0000 7fafe3400640 1 -- 172.21.15.149:0/1722918201 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8032440 con 0x7fafe40b2bb0 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.917+0000 7fafe3400640 1 -- 172.21.15.149:0/1722918201 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80325a0 con 0x7fafe40b2bb0 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.917+0000 7fafe3400640 1 -- 172.21.15.149:0/1722918201 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8032980 con 0x7fafe40b2bb0 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 -- 172.21.15.149:0/1722918201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 msgr2=0x7fafe40b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 --2- 172.21.15.149:0/1722918201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe40b2f80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009910 tx=0x7fafd80091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 -- 172.21.15.149:0/1722918201 shutdown_connections 2024-08-17T02:50:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 --2- 172.21.15.149:0/1722918201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40b5740 0x7fafe415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 --2- 172.21.15.149:0/1722918201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe40b2f80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 -- 172.21.15.149:0/1722918201 >> 172.21.15.149:0/1722918201 conn(0x7fafe40cfbc0 msgr2=0x7fafe40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 -- 172.21.15.149:0/1722918201 shutdown_connections 2024-08-17T02:50:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.918+0000 7fafea200640 1 -- 172.21.15.149:0/1722918201 wait complete. 2024-08-17T02:50:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.919+0000 7fafea200640 1 Processor -- start 2024-08-17T02:50:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.919+0000 7fafea200640 1 -- start start 2024-08-17T02:50:17.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafea200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe4143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafea200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40b5740 0x7fafe415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafea200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe415c2e0 0x7fafe415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafea200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b0a60 con 0x7fafe40b2bb0 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafea200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b0d40 con 0x7fafe40b5740 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafea200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b1020 con 0x7fafe415c2e0 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.920+0000 7fafe8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe4143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe4143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42380/0 (socket says 172.21.15.149:42380) 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 -- 172.21.15.149:0/2395466595 learned_addr learned my addr 172.21.15.149:0/2395466595 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe9800640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe415c2e0 0x7fafe415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe3e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40b5740 0x7fafe415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 -- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe415c2e0 msgr2=0x7fafe415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe415c2e0 0x7fafe415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 -- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40b5740 msgr2=0x7fafe415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40b5740 0x7fafe415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 -- 172.21.15.149:0/2395466595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009450 con 0x7fafe40b2bb0 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe9800640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe415c2e0 0x7fafe415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafe8e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe4143de0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fafd8035040 tx=0x7fafd8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8031b30 con 0x7fafe40b2bb0 2024-08-17T02:50:17.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8031cf0 con 0x7fafe40b2bb0 2024-08-17T02:50:17.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe40b1300 con 0x7fafe40b2bb0 2024-08-17T02:50:17.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.921+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd803d670 con 0x7fafe40b2bb0 2024-08-17T02:50:17.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.922+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe4144320 con 0x7fafe40b2bb0 2024-08-17T02:50:17.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.922+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafe4071050 con 0x7fafe40b2bb0 2024-08-17T02:50:17.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.923+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fafd8039040 con 0x7fafe40b2bb0 2024-08-17T02:50:17.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.924+0000 7fafd7e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc4065150 0x7fafc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.924+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fafd80a1f80 con 0x7fafe40b2bb0 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.924+0000 7fafd7e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fafc406b040 0x7fafc406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.924+0000 7fafe3e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc4065150 0x7fafc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.924+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 --> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafc406db00 con 0x7fafc406b040 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.924+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafd80a4480 con 0x7fafe40b2bb0 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.925+0000 7fafe9800640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fafc406b040 0x7fafc406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.925+0000 7fafe3e00640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc4065150 0x7fafc4067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fafe415fb50 tx=0x7fafd0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.925+0000 7fafe9800640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fafc406b040 0x7fafc406d450 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.929 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.926+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== osd.7 v2:172.21.15.161:6816/37102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fafc406db00 con 0x7fafc406b040 2024-08-17T02:50:17.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.939+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 --> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fafe4066ee0 con 0x7fafc406b040 2024-08-17T02:50:17.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.939+0000 7fafd7e00640 1 -- 172.21.15.149:0/2395466595 <== osd.7 v2:172.21.15.161:6816/37102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fafe4066ee0 con 0x7fafc406b040 2024-08-17T02:50:17.940 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-08-17T02:50:17.940 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:17.940 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-08-17T02:50:17.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fafc406b040 msgr2=0x7fafc406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.161:6816/37102,v1:172.21.15.161:6817/37102] conn(0x7fafc406b040 0x7fafc406d450 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc4065150 msgr2=0x7fafc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fafc4065150 0x7fafc4067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fafe415fb50 tx=0x7fafd0008040 comp rx=0 tx=0).stop 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 msgr2=0x7fafe4143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 --2- 172.21.15.149:0/2395466595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe40b2bb0 0x7fafe4143de0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fafd8035040 tx=0x7fafd8032000 comp rx=0 tx=0).stop 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafe9800640 1 -- 172.21.15.149:0/2395466595 reap_dead start 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 shutdown_connections 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 >> 172.21.15.149:0/2395466595 conn(0x7fafe40cfbc0 msgr2=0x7fafe4157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 shutdown_connections 2024-08-17T02:50:17.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:17.940+0000 7fafea200640 1 -- 172.21.15.149:0/2395466595 wait complete. 2024-08-17T02:50:17.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:50:18.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.105+0000 7f8583200640 1 Processor -- start 2024-08-17T02:50:18.106 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.105+0000 7f8583200640 1 -- start start 2024-08-17T02:50:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.106+0000 7f8583200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.106+0000 7f8583200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f857c0b1440 0x7f857c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.106+0000 7f8583200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0caa80 con 0x7f857c140580 2024-08-17T02:50:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f8583200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0cb450 con 0x7f857c0b1440 2024-08-17T02:50:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f8583200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0c9e70 con 0x7f857c1401b0 2024-08-17T02:50:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f8573400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f857c140580 0x7f857c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42112/0 (socket says 172.21.15.149:42112) 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f8573400640 1 -- 172.21.15.149:0/589061438 learned_addr learned my addr 172.21.15.149:0/589061438 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857be00640 1 --2- 172.21.15.149:0/589061438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f8581200640 1 --2- 172.21.15.149:0/589061438 >> v2:172.21.15.161:3300/0 conn(0x7f857c0b1440 0x7f857c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857b400640 1 -- 172.21.15.149:0/589061438 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720646431 0 0) 0x7f857c0caa80 con 0x7f857c140580 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857b400640 1 -- 172.21.15.149:0/589061438 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85600034e0 con 0x7f857c140580 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857be00640 1 -- 172.21.15.149:0/589061438 >> v2:172.21.15.161:3300/0 conn(0x7f857c0b1440 msgr2=0x7f857c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857be00640 1 --2- 172.21.15.149:0/589061438 >> v2:172.21.15.161:3300/0 conn(0x7f857c0b1440 0x7f857c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857be00640 1 -- 172.21.15.149:0/589061438 >> v1:172.21.15.149:6789/0 conn(0x7f857c140580 legacy=0x7f857c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.107+0000 7f857be00640 1 -- 172.21.15.149:0/589061438 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0ca150 con 0x7f857c1401b0 2024-08-17T02:50:18.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.109+0000 7f857be00640 1 --2- 172.21.15.149:0/589061438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0caf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f856c009850 tx=0x7f856c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9afc0bc1c6e21699 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.109+0000 7f857b400640 1 -- 172.21.15.149:0/589061438 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c02ad00 con 0x7f857c1401b0 2024-08-17T02:50:18.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.109+0000 7f857b400640 1 -- 172.21.15.149:0/589061438 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c02ae60 con 0x7f857c1401b0 2024-08-17T02:50:18.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.109+0000 7f857b400640 1 -- 172.21.15.149:0/589061438 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c032670 con 0x7f857c1401b0 2024-08-17T02:50:18.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.109+0000 7f8583200640 1 -- 172.21.15.149:0/589061438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 msgr2=0x7f857c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.109+0000 7f8583200640 1 --2- 172.21.15.149:0/589061438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0caf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f856c009850 tx=0x7f856c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.110+0000 7f8583200640 1 -- 172.21.15.149:0/589061438 shutdown_connections 2024-08-17T02:50:18.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.110+0000 7f8583200640 1 --2- 172.21.15.149:0/589061438 >> v2:172.21.15.161:3300/0 conn(0x7f857c0b1440 0x7f857c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.110+0000 7f8583200640 1 --2- 172.21.15.149:0/589061438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0caf10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.110+0000 7f8583200640 1 -- 172.21.15.149:0/589061438 >> 172.21.15.149:0/589061438 conn(0x7f857c0cb9b0 msgr2=0x7f857c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:18.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.110+0000 7f8583200640 1 -- 172.21.15.149:0/589061438 shutdown_connections 2024-08-17T02:50:18.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.110+0000 7f8583200640 1 -- 172.21.15.149:0/589061438 wait complete. 2024-08-17T02:50:18.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.111+0000 7f8583200640 1 Processor -- start 2024-08-17T02:50:18.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.111+0000 7f8583200640 1 -- start start 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f8583200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 0x7f857c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f8583200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f8583200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f857c140580 0x7f857c0c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f8583200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c13f5e0 con 0x7f857c0b1440 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f8583200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0ab460 con 0x7f857c140580 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f8583200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0aa850 con 0x7f857c1401b0 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f857be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 0x7f857c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f857be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 0x7f857c0ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42386/0 (socket says 172.21.15.149:42386) 2024-08-17T02:50:18.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.112+0000 7f857be00640 1 -- 172.21.15.149:0/303759305 learned_addr learned my addr 172.21.15.149:0/303759305 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8573400640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8581200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f857c140580 0x7f857c0c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f857be00640 1 -- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 msgr2=0x7f857c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f857be00640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f857be00640 1 -- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f857c140580 msgr2=0x7f857c0c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f857be00640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f857c140580 0x7f857c0c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f857be00640 1 -- 172.21.15.149:0/303759305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009390 con 0x7f857c0b1440 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8581200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f857c140580 0x7f857c0c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:18.116 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8573400640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:18.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f857be00640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 0x7f857c0ab8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f856c009360 tx=0x7f856c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c03b6e0 con 0x7f857c0b1440 2024-08-17T02:50:18.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c03b840 con 0x7f857c0b1440 2024-08-17T02:50:18.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c0aab30 con 0x7f857c0b1440 2024-08-17T02:50:18.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c03bc00 con 0x7f857c0b1440 2024-08-17T02:50:18.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.113+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0ab0f0 con 0x7f857c0b1440 2024-08-17T02:50:18.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.114+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c064db0 con 0x7f857c0b1440 2024-08-17T02:50:18.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.115+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f856c043030 con 0x7f857c0b1440 2024-08-17T02:50:18.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.116+0000 7f8573e00640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8558065180 0x7f8558067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.116+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f856c041070 con 0x7f857c0b1440 2024-08-17T02:50:18.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.116+0000 7f8573400640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8558065180 0x7f8558067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.117+0000 7f8573400640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8558065180 0x7f8558067630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8564007fd0 tx=0x7f8564009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.121+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f856c070930 con 0x7f857c0b1440 2024-08-17T02:50:18.296 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.295+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f857c0ab5a0 con 0x7f8558065180 2024-08-17T02:50:18.296 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.295+0000 7f8573e00640 1 -- 172.21.15.149:0/303759305 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8564005870 con 0x7f8558065180 2024-08-17T02:50:18.296 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:50:18.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8558065180 msgr2=0x7f8558067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8558065180 0x7f8558067630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8564007fd0 tx=0x7f8564009040 comp rx=0 tx=0).stop 2024-08-17T02:50:18.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 msgr2=0x7f857c0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 0x7f857c0ab8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f856c009360 tx=0x7f856c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 shutdown_connections 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f8558065180 0x7f8558067630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f857c140580 0x7f857c0c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f857c1401b0 0x7f857c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 --2- 172.21.15.149:0/303759305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857c0b1440 0x7f857c0ab8f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 >> 172.21.15.149:0/303759305 conn(0x7f857c0cb9b0 msgr2=0x7f857c159310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.297+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 shutdown_connections 2024-08-17T02:50:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.298+0000 7f8583200640 1 -- 172.21.15.149:0/303759305 wait complete. 2024-08-17T02:50:18.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.460+0000 7fc249000640 1 Processor -- start 2024-08-17T02:50:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.461+0000 7fc249000640 1 -- start start 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc249000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2440b0270 0x7fc2441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc249000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 0x7fc2440ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc249000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc244157690 con 0x7fc244155900 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc249000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc244156a80 con 0x7fc2440b0270 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc249000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc244156d60 con 0x7fc244158b30 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc243400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc244155900 0x7fc244155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42126/0 (socket says 172.21.15.149:42126) 2024-08-17T02:50:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.462+0000 7fc243400640 1 -- 172.21.15.149:0/3020930964 learned_addr learned my addr 172.21.15.149:0/3020930964 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:18.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc243e00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 0x7fc2440ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc23aa00640 1 --2- 172.21.15.149:0/3020930964 >> v2:172.21.15.161:3300/0 conn(0x7fc2440b0270 0x7fc2441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889389922 0 0) 0x7fc244157690 con 0x7fc244155900 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2280034e0 con 0x7fc244155900 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3381673349 0 0) 0x7fc2280034e0 con 0x7fc244155900 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 msgr2=0x7fc2440ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 0x7fc2440ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.466 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 >> v2:172.21.15.161:3300/0 conn(0x7fc2440b0270 msgr2=0x7fc2441563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 --2- 172.21.15.149:0/3020930964 >> v2:172.21.15.161:3300/0 conn(0x7fc2440b0270 0x7fc2441563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244157040 con 0x7fc244155900 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7fc234001470 con 0x7fc244155900 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 >> v1:172.21.15.149:6789/0 conn(0x7fc244155900 legacy=0x7fc244155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 0x7fc2280039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc228003f50 0x7fc228004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228004cc0 0x7fc228005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244156a80 con 0x7fc228003f50 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244156d60 con 0x7fc228004cc0 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22800ba00 con 0x7fc244158b30 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.463+0000 7fc23aa00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc228003f50 0x7fc228004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc243400640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 0x7fc2280039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc243e00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228004cc0 0x7fc228005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc23aa00640 1 -- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 msgr2=0x7fc2280039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc23aa00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc244158b30 0x7fc2280039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc23aa00640 1 -- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228004cc0 msgr2=0x7fc228005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc23aa00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228004cc0 0x7fc228005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.464+0000 7fc23aa00640 1 -- 172.21.15.149:0/3020930964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280034e0 con 0x7fc228003f50 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.465+0000 7fc23aa00640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc228003f50 0x7fc228004780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009b70 tx=0x7fc22c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ebbfcc994cc767 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.465+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c033400 con 0x7fc228003f50 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.465+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c02f050 con 0x7fc228003f50 2024-08-17T02:50:18.469 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.465+0000 7fc242a00640 1 -- 172.21.15.149:0/3020930964 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c033790 con 0x7fc228003f50 2024-08-17T02:50:18.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc249000640 1 -- 172.21.15.149:0/3020930964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc228003f50 msgr2=0x7fc228004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc249000640 1 --2- 172.21.15.149:0/3020930964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc228003f50 0x7fc228004780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009b70 tx=0x7fc22c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc243e00640 1 -- 172.21.15.149:0/3020930964 reap_dead start 2024-08-17T02:50:18.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc249000640 1 -- 172.21.15.149:0/3020930964 shutdown_connections 2024-08-17T02:50:18.472 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc249000640 1 -- 172.21.15.149:0/3020930964 >> 172.21.15.149:0/3020930964 conn(0x7fc244067750 msgr2=0x7fc2440cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc249000640 1 -- 172.21.15.149:0/3020930964 shutdown_connections 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.466+0000 7fc249000640 1 -- 172.21.15.149:0/3020930964 wait complete. 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.467+0000 7fc249000640 1 Processor -- start 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.467+0000 7fc249000640 1 -- start start 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc249000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228003f50 0x7fc24416cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc249000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2440ac090 0x7fc2441690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc249000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 0x7fc2440c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.473 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc249000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24416cae0 con 0x7fc244151890 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc249000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244169a00 con 0x7fc228003f50 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc249000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc244169ce0 con 0x7fc2440ac090 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc243e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 0x7fc2440c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc243e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 0x7fc2440c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42406/0 (socket says 172.21.15.149:42406) 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.468+0000 7fc243e00640 1 -- 172.21.15.149:0/676260771 learned_addr learned my addr 172.21.15.149:0/676260771 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc23aa00640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2440ac090 0x7fc2441690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243400640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228003f50 0x7fc24416cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243e00640 1 -- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2440ac090 msgr2=0x7fc2441690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243e00640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2440ac090 0x7fc2441690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243e00640 1 -- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228003f50 msgr2=0x7fc24416cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243e00640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228003f50 0x7fc24416cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243e00640 1 -- 172.21.15.149:0/676260771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244169fc0 con 0x7fc244151890 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc243e00640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 0x7fc2440c1e90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc24406aa70 tx=0x7fc23c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00e070 con 0x7fc244151890 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0156b0 con 0x7fc244151890 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c015a70 con 0x7fc244151890 2024-08-17T02:50:18.475 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.469+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24416c770 con 0x7fc244151890 2024-08-17T02:50:18.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.470+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244169610 con 0x7fc244151890 2024-08-17T02:50:18.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.471+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24416cc50 con 0x7fc244151890 2024-08-17T02:50:18.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.471+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc23c016470 con 0x7fc244151890 2024-08-17T02:50:18.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.472+0000 7fc23b400640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc220065150 0x7fc220067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.472+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc23c082440 con 0x7fc244151890 2024-08-17T02:50:18.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.473+0000 7fc243400640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc220065150 0x7fc220067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.473+0000 7fc243400640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc220065150 0x7fc220067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc234001620 tx=0x7fc234001e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.476+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc23c050850 con 0x7fc244151890 2024-08-17T02:50:18.650 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.649+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc244071050 con 0x7fc220065150 2024-08-17T02:50:18.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.651+0000 7fc23b400640 1 -- 172.21.15.149:0/676260771 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50481 (secure 0 0 0) 0x7fc244071050 con 0x7fc220065150 2024-08-17T02:50:18.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:18.653 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:50:18.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc220065150 msgr2=0x7fc220067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc220065150 0x7fc220067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc234001620 tx=0x7fc234001e90 comp rx=0 tx=0).stop 2024-08-17T02:50:18.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 msgr2=0x7fc2440c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 0x7fc2440c1e90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc24406aa70 tx=0x7fc23c00b040 comp rx=0 tx=0).stop 2024-08-17T02:50:18.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 shutdown_connections 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7fc220065150 0x7fc220067600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc244151890 0x7fc2440c1e90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2440ac090 0x7fc2441690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 --2- 172.21.15.149:0/676260771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228003f50 0x7fc24416cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 >> 172.21.15.149:0/676260771 conn(0x7fc244067750 msgr2=0x7fc244068670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 shutdown_connections 2024-08-17T02:50:18.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:18.654+0000 7fc249000640 1 -- 172.21.15.149:0/676260771 wait complete. 2024-08-17T02:50:18.670 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-08-17T02:50:17.680283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388316,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586404,"statfs":{"total":773094113280,"available":770648477696,"internally_reserved":0,"allocated":5414912,"data_stored":2941208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001701"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:50:07.828986+0000","last_change":"2024-08-17T02:46:37.455798+0000","last_active":"2024-08-17T02:50:07.828986+0000","last_peered":"2024-08-17T02:50:07.828986+0000","last_clean":"2024-08-17T02:50:07.828986+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:50:07.828986+0000","last_undegraded":"2024-08-17T02:50:07.828986+0000","last_fullsized":"2024-08-17T02:50:07.828986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:35.968678+0000","last_clean_scrub_stamp":"2024-08-17T02:46:35.968678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:12.865820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298456,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073384,"statfs":{"total":96636764160,"available":96331145216,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":2.722,"15min":2.722},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.628}]},{"osd":1,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":2.23,"15min":2.23},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.86399999999999999,"5min":1.077,"15min":1.077},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94199999999999995,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92000000000000004,"5min":2.472,"15min":2.472},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":1.423,"15min":1.423},"last":0.748},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":1.492,"15min":1.492},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.65100000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.48699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.746},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.443,"15min":0.443},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.044,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.58199999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.78500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95499999999999996,"5min":1.095,"15min":1.095},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626}]},{"osd":5,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.472,"15min":1.472},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71599999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.499}]},{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.61899999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81999999999999995,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":3.552,"15min":3.552},"last":0.749}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83999999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94299999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67600000000000005,"5min":1.103,"15min":1.103},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":1.333,"15min":1.333},"last":0.73099999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91600000000000004,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97399999999999998,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.71499999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.56999999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.5}]},{"osd":2,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.498,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.077,"15min":1.077},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.129,"15min":1.129},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.016,"15min":1.016},"last":0.751},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90600000000000003,"5min":1.363,"15min":1.363},"last":0.73199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78700000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55600000000000005,"5min":3.6120000000000001,"15min":3.6120000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83999999999999997,"5min":1.516,"15min":1.516},"last":0.442}]},{"osd":1,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65700000000000003,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70299999999999996,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":0.95099999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":2.456,"15min":2.456},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1000000000000001,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":1.0229999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0980000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.84299999999999997,"15min":0.86799999999999999},"min":{"1min":0.58299999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.02,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.627,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0820000000000001,"5min":1.718,"15min":1.718},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.163,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.649,"15min":2.649},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.131,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.091}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.175,"15min":1.175},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":1.347,"15min":1.347},"last":0.35699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67200000000000004,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85599999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.58399999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93899999999999995,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97999999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.88400000000000001,"15min":0.95899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.504},{"interface":"front","average":{"1min":0.746,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0720000000000001,"5min":1.401,"15min":1.401},"last":0.63},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.70699999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.96799999999999997},"min":{"1min":0.58299999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.143,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90000000000000002,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.006,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.60599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.52400000000000002,"15min":0.57599999999999996},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53300000000000003,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.60899999999999999,"15min":0.67900000000000005},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.58999999999999997,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":2.274,"15min":2.274},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":3.653,"15min":3.653},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97799999999999998,"5min":1.284,"15min":1.284},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.90800000000000003,"15min":0.96399999999999997},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.86299999999999999,"15min":0.92100000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.96799999999999997,"15min":1.0660000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76900000000000002,"15min":0.74299999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.92200000000000004,"15min":0.97799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0940000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.1459999999999999,"15min":1.298},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0720000000000001,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.121,"15min":1.256},"min":{"1min":0.66800000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0549999999999999,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.70399999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":2.137,"15min":2.137},"last":0.44}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.503,"15min":0.497},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":1.516,"15min":1.516},"last":0.502},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.63400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1040000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.071,"5min":1.603,"15min":1.603},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.75},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.68500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0049999999999999,"5min":1.649,"15min":1.649},"last":0.83699999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.675,"15min":1.675},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:18.674 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:46:35.968678+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=46, tm_sec=35, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=50, tm_sec=12, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:50:18.675 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:50:38.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:38.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.836+0000 7f45d6800640 1 Processor -- start 2024-08-17T02:50:38.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.836+0000 7f45d6800640 1 -- start start 2024-08-17T02:50:38.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.837+0000 7f45d6800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d006da20 0x7f45d006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:38.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45d6800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d00a9a10 con 0x7f45d00aa7d0 2024-08-17T02:50:38.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45d6800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d00a9cf0 con 0x7f45d0158fa0 2024-08-17T02:50:38.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45d6800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00ac400 con 0x7f45d006da20 2024-08-17T02:50:38.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45c7e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f45d00aa7d0 0x7f45d0158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60694/0 (socket says 172.21.15.149:60694) 2024-08-17T02:50:38.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45c7e00640 1 -- 172.21.15.149:0/4215427190 learned_addr learned my addr 172.21.15.149:0/4215427190 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:38.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45cf400640 1 --2- 172.21.15.149:0/4215427190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d006da20 0x7f45d006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:38.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500466013 0 0) 0x7f45d00a9a10 con 0x7f45d00aa7d0 2024-08-17T02:50:38.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b40034e0 con 0x7f45d00aa7d0 2024-08-17T02:50:38.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.838+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761423131 0 0) 0x7f45d00a9cf0 con 0x7f45d0158fa0 2024-08-17T02:50:38.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.839+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d00a9a10 con 0x7f45d0158fa0 2024-08-17T02:50:38.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.839+0000 7f45cf400640 1 -- 172.21.15.149:0/4215427190 >> v1:172.21.15.161:6789/0 conn(0x7f45d0158fa0 legacy=0x7f45d00ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:38.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.839+0000 7f45cf400640 1 -- 172.21.15.149:0/4215427190 >> v1:172.21.15.149:6789/0 conn(0x7f45d00aa7d0 legacy=0x7f45d0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:38.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.839+0000 7f45cf400640 1 -- 172.21.15.149:0/4215427190 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00a9fd0 con 0x7f45d006da20 2024-08-17T02:50:38.841 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.840+0000 7f45cf400640 1 --2- 172.21.15.149:0/4215427190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d006da20 0x7f45d006ddf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009880 tx=0x7f45c00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef38ae33278a3b42 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:38.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.840+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c002ad70 con 0x7f45d006da20 2024-08-17T02:50:38.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.840+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0032440 con 0x7f45d006da20 2024-08-17T02:50:38.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.840+0000 7f45cea00640 1 -- 172.21.15.149:0/4215427190 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00327e0 con 0x7f45d006da20 2024-08-17T02:50:38.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 -- 172.21.15.149:0/4215427190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d006da20 msgr2=0x7f45d006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:38.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 --2- 172.21.15.149:0/4215427190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d006da20 0x7f45d006ddf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009880 tx=0x7f45c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:38.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 -- 172.21.15.149:0/4215427190 shutdown_connections 2024-08-17T02:50:38.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 --2- 172.21.15.149:0/4215427190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d006da20 0x7f45d006ddf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:38.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 -- 172.21.15.149:0/4215427190 >> 172.21.15.149:0/4215427190 conn(0x7f45d00cb9b0 msgr2=0x7f45d00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:38.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 -- 172.21.15.149:0/4215427190 shutdown_connections 2024-08-17T02:50:38.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.841+0000 7f45d6800640 1 -- 172.21.15.149:0/4215427190 wait complete. 2024-08-17T02:50:38.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.842+0000 7f45d6800640 1 Processor -- start 2024-08-17T02:50:38.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 -- start start 2024-08-17T02:50:38.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d006da20 0x7f45d015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:38.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 0x7f45d0159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d0158fa0 0x7f45d0148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015a430 con 0x7f45d00aa7d0 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d014c320 con 0x7f45d006da20 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.843+0000 7f45d6800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0159960 con 0x7f45d0158fa0 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 0x7f45d0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 0x7f45d0159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36478/0 (socket says 172.21.15.149:36478) 2024-08-17T02:50:38.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 -- 172.21.15.149:0/1767030262 learned_addr learned my addr 172.21.15.149:0/1767030262 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45cf400640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d006da20 0x7f45d015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45cfe00640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d0158fa0 0x7f45d0148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 -- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d0158fa0 msgr2=0x7f45d0148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d0158fa0 0x7f45d0148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 -- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d006da20 msgr2=0x7f45d015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d006da20 0x7f45d015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 -- 172.21.15.149:0/1767030262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0009390 con 0x7f45d00aa7d0 2024-08-17T02:50:38.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45cf400640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d006da20 0x7f45d015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.844+0000 7f45c7e00640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 0x7f45d0159420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f45b800c790 tx=0x7f45b8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.845+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800ce60 con 0x7f45d00aa7d0 2024-08-17T02:50:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.845+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8005870 con 0x7f45d00aa7d0 2024-08-17T02:50:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.845+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8005c70 con 0x7f45d00aa7d0 2024-08-17T02:50:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.845+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d0148aa0 con 0x7f45d00aa7d0 2024-08-17T02:50:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.845+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d0159b90 con 0x7f45d00aa7d0 2024-08-17T02:50:38.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.846+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d014c790 con 0x7f45d00aa7d0 2024-08-17T02:50:38.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.846+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f45b8007300 con 0x7f45d00aa7d0 2024-08-17T02:50:38.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.847+0000 7f45c6a00640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f45ac065180 0x7f45ac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:38.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.847+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f45b8081d30 con 0x7f45d00aa7d0 2024-08-17T02:50:38.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.848+0000 7f45cf400640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f45ac065180 0x7f45ac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:38.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.848+0000 7f45cf400640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f45ac065180 0x7f45ac067630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f45c0034000 tx=0x7f45c0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:38.852 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:38.851+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f45d014c790 con 0x7f45d00aa7d0 2024-08-17T02:50:39.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.022+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 --> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45d014c790 con 0x7f45ac065180 2024-08-17T02:50:39.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.025+0000 7f45c6a00640 1 -- 172.21.15.149:0/1767030262 <== mgr.4113 v2:172.21.15.149:6832/36958 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50556 (secure 0 0 0) 0x7f45d014c790 con 0x7f45ac065180 2024-08-17T02:50:39.026 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:39.026 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2024-08-17T02:50:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f45ac065180 msgr2=0x7f45ac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f45ac065180 0x7f45ac067630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f45c0034000 tx=0x7f45c0032000 comp rx=0 tx=0).stop 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 msgr2=0x7f45d0159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 0x7f45d0159420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f45b800c790 tx=0x7f45b8007db0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 shutdown_connections 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f45ac065180 0x7f45ac067630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45d0158fa0 0x7f45d0148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d00aa7d0 0x7f45d0159420 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 --2- 172.21.15.149:0/1767030262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d006da20 0x7f45d015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 >> 172.21.15.149:0/1767030262 conn(0x7f45d00cb9b0 msgr2=0x7f45d00687c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:39.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 shutdown_connections 2024-08-17T02:50:39.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.027+0000 7f45d6800640 1 -- 172.21.15.149:0/1767030262 wait complete. 2024-08-17T02:50:39.043 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-08-17T02:50:37.684570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388300,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586420,"statfs":{"total":773094113280,"available":770648494080,"internally_reserved":0,"allocated":5414912,"data_stored":2941208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002468"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":196,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-17T02:50:21.826530+0000","last_change":"2024-08-17T02:50:21.826498+0000","last_active":"2024-08-17T02:50:21.826530+0000","last_peered":"2024-08-17T02:50:21.826530+0000","last_clean":"2024-08-17T02:50:21.826530+0000","last_became_active":"2024-08-17T02:46:37.454503+0000","last_became_peered":"2024-08-17T02:46:37.454503+0000","last_unstale":"2024-08-17T02:50:21.826530+0000","last_undegraded":"2024-08-17T02:50:21.826530+0000","last_fullsized":"2024-08-17T02:50:21.826530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2024-08-17T02:50:21.826406+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2024-08-17T02:50:21.826406+0000","last_clean_scrub_stamp":"2024-08-17T02:50:21.826406+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:11.835251+0000","scrub_duration":0.0061822070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":2.722,"15min":2.722},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":2.23,"15min":2.23},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.86399999999999999,"5min":1.077,"15min":1.077},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94199999999999995,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92000000000000004,"5min":2.472,"15min":2.472},"last":0.79600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":1.423,"15min":1.423},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.51100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":1.492,"15min":1.492},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.47599999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.48699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.64000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.443,"15min":0.443},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.63}]},{"osd":3,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.044,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.749},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.58199999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95499999999999996,"5min":1.095,"15min":1.095},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.472,"15min":1.472},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.58099999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72499999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.61899999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.91600000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81999999999999995,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":3.552,"15min":3.552},"last":0.77400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83999999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.875},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94299999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67600000000000005,"5min":1.103,"15min":1.103},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":1.333,"15min":1.333},"last":0.749}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91600000000000004,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97399999999999998,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.002}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.56999999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.72899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.498,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.93300000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.627},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.077,"15min":1.077},"last":0.871}]},{"osd":5,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.751},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.129,"15min":1.129},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.016,"15min":1.016},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90600000000000003,"5min":1.363,"15min":1.363},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.90900000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55600000000000005,"5min":3.6120000000000001,"15min":3.6120000000000001},"last":0.438},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83999999999999997,"5min":1.516,"15min":1.516},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65700000000000003,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70299999999999996,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":2.456,"15min":2.456},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1000000000000001,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0980000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.84299999999999997,"15min":0.86799999999999999},"min":{"1min":0.58299999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.02,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.627,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0820000000000001,"5min":1.718,"15min":1.718},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.163,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.649,"15min":2.649},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.131,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.69299999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.175,"15min":1.175},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":1.347,"15min":1.347},"last":0.377}]},{"osd":1,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67200000000000004,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85599999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.65100000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.58399999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93899999999999995,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97999999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.624}]},{"osd":5,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.88400000000000001,"15min":0.95899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0720000000000001,"5min":1.401,"15min":1.401},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.70699999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76900000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.96799999999999997},"min":{"1min":0.58299999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.143,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90000000000000002,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.006,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.66600000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":220059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.52400000000000002,"15min":0.57599999999999996},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53300000000000003,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.60899999999999999,"15min":0.67900000000000005},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.58999999999999997,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":2.274,"15min":2.274},"last":0.374}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":3.653,"15min":3.653},"last":0.628},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56999999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97799999999999998,"5min":1.284,"15min":1.284},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.90800000000000003,"15min":0.96399999999999997},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.86299999999999999,"15min":0.92100000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.96799999999999997,"15min":1.0660000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":6.3120000000000003,"15min":6.3120000000000003},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76900000000000002,"15min":0.74299999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.92200000000000004,"15min":0.97799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0940000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.1459999999999999,"15min":1.298},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0720000000000001,"5min":9.5500000000000007,"15min":9.5500000000000007},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.121,"15min":1.256},"min":{"1min":0.66800000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0549999999999999,"5min":8.7720000000000002,"15min":8.7720000000000002},"last":0.95099999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302608,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069232,"statfs":{"total":96636764160,"available":96326893568,"internally_reserved":0,"allocated":1122304,"data_stored":810427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.621},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":2.137,"15min":2.137},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.503,"15min":0.497},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":1.516,"15min":1.516},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.63400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1040000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.71199999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.071,"5min":1.603,"15min":1.603},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.74299999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.68500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0049999999999999,"5min":1.649,"15min":1.649},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.675,"15min":1.675},"last":0.83499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:39.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:50:39.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.189+0000 7f57bf200640 1 Processor -- start 2024-08-17T02:50:39.190 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.189+0000 7f57bf200640 1 -- start start 2024-08-17T02:50:39.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57bf200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57c0158a30 0x7f57c00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57bf200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57c00ce890 0x7f57c00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57bf200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00c61d0 con 0x7f57c00c4a20 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57bf200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00c64b0 con 0x7f57c00ce890 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57bf200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00c6790 con 0x7f57c0158a30 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57be800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57c00ce890 0x7f57c00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.190+0000 7f57be800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57c00ce890 0x7f57c00cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36490/0 (socket says 172.21.15.149:36490) 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57be800640 1 -- 172.21.15.149:0/1719766326 learned_addr learned my addr 172.21.15.149:0/1719766326 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:39.192 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57bde00640 1 --2- 172.21.15.149:0/1719766326 >> v2:172.21.15.161:3300/0 conn(0x7f57c0158a30 0x7f57c00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57be800640 1 -- 172.21.15.149:0/1719766326 >> v2:172.21.15.161:3300/0 conn(0x7f57c0158a30 msgr2=0x7f57c00c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:39.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57be800640 1 --2- 172.21.15.149:0/1719766326 >> v2:172.21.15.161:3300/0 conn(0x7f57c0158a30 0x7f57c00c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57be800640 1 -- 172.21.15.149:0/1719766326 >> v1:172.21.15.161:6789/0 conn(0x7f57c00c4a20 legacy=0x7f57c00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:39.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57be800640 1 -- 172.21.15.149:0/1719766326 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00cab70 con 0x7f57c00ce890 2024-08-17T02:50:39.193 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.191+0000 7f57bde00640 1 --2- 172.21.15.149:0/1719766326 >> v2:172.21.15.161:3300/0 conn(0x7f57c0158a30 0x7f57c00c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:39.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.192+0000 7f57be800640 1 --2- 172.21.15.149:0/1719766326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c00ce890 0x7f57c00cb370 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f57c0069620 tx=0x7f57b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2c1061d121a020 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:39.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.192+0000 7f57bca00640 1 -- 172.21.15.149:0/1719766326 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8031400 con 0x7f57c00ce890 2024-08-17T02:50:39.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.192+0000 7f57bca00640 1 -- 172.21.15.149:0/1719766326 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b802d050 con 0x7f57c00ce890 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.192+0000 7f57bca00640 1 -- 172.21.15.149:0/1719766326 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80317d0 con 0x7f57c00ce890 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 -- 172.21.15.149:0/1719766326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c00ce890 msgr2=0x7f57c00cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 --2- 172.21.15.149:0/1719766326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c00ce890 0x7f57c00cb370 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f57c0069620 tx=0x7f57b8009840 comp rx=0 tx=0).stop 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 -- 172.21.15.149:0/1719766326 shutdown_connections 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 --2- 172.21.15.149:0/1719766326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c00ce890 0x7f57c00cb370 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 --2- 172.21.15.149:0/1719766326 >> v2:172.21.15.161:3300/0 conn(0x7f57c0158a30 0x7f57c00c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.195 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 -- 172.21.15.149:0/1719766326 >> 172.21.15.149:0/1719766326 conn(0x7f57c0098e30 msgr2=0x7f57c006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:39.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 -- 172.21.15.149:0/1719766326 shutdown_connections 2024-08-17T02:50:39.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.193+0000 7f57bf200640 1 -- 172.21.15.149:0/1719766326 wait complete. 2024-08-17T02:50:39.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.194+0000 7f57bf200640 1 Processor -- start 2024-08-17T02:50:39.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.194+0000 7f57bf200640 1 -- start start 2024-08-17T02:50:39.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.195+0000 7f57bf200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57c00c4a20 0x7f57c009d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.195+0000 7f57bf200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57c00ce890 0x7f57c00b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.195+0000 7f57bf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 0x7f57c01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.195+0000 7f57bf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00997a0 con 0x7f57c0158a30 2024-08-17T02:50:39.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.195+0000 7f57bf200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00b2460 con 0x7f57c00c4a20 2024-08-17T02:50:39.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.195+0000 7f57bf200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0142f40 con 0x7f57c00ce890 2024-08-17T02:50:39.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 0x7f57c01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.199 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 0x7f57c01573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36506/0 (socket says 172.21.15.149:36506) 2024-08-17T02:50:39.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 -- 172.21.15.149:0/2890916525 learned_addr learned my addr 172.21.15.149:0/2890916525 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:39.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57bde00640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57c00c4a20 0x7f57c009d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57bd400640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57c00ce890 0x7f57c00b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 -- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57c00ce890 msgr2=0x7f57c00b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57c00ce890 0x7f57c00b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 -- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57c00c4a20 msgr2=0x7f57c009d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57c00c4a20 0x7f57c009d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 -- 172.21.15.149:0/2890916525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009ae0 con 0x7f57c0158a30 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57bd400640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57c00ce890 0x7f57c00b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57be800640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 0x7f57c01573e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009f50 tx=0x7f57b8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.196+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8008e50 con 0x7f57c0158a30 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.197+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b803b410 con 0x7f57c0158a30 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.197+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c016c910 con 0x7f57c0158a30 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.197+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b803b7d0 con 0x7f57c0158a30 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.197+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c016ced0 con 0x7f57c0158a30 2024-08-17T02:50:39.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.198+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0071050 con 0x7f57c0158a30 2024-08-17T02:50:39.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.198+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f57b8038050 con 0x7f57c0158a30 2024-08-17T02:50:39.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.199+0000 7f57b5600640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f57a0065150 0x7f57a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.200+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f57b80a3370 con 0x7f57c0158a30 2024-08-17T02:50:39.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.200+0000 7f57bde00640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f57a0065150 0x7f57a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.200+0000 7f57bde00640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f57a0065150 0x7f57a0067600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f57b000ac20 tx=0x7f57b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:39.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.203+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f57b80716e0 con 0x7f57c0158a30 2024-08-17T02:50:39.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.373+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f57c00cf950 con 0x7f57c0158a30 2024-08-17T02:50:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.377+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f57b80716e0 con 0x7f57c0158a30 2024-08-17T02:50:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.378+0000 7f57b5600640 1 -- 172.21.15.149:0/2890916525 <== mon.0 v2:172.21.15.149:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f57b8074d00 con 0x7f57c0158a30 2024-08-17T02:50:39.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f57a0065150 msgr2=0x7f57a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f57a0065150 0x7f57a0067600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f57b000ac20 tx=0x7f57b0008040 comp rx=0 tx=0).stop 2024-08-17T02:50:39.381 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 msgr2=0x7f57c01573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 0x7f57c01573e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009f50 tx=0x7f57b8034000 comp rx=0 tx=0).stop 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 shutdown_connections 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f57a0065150 0x7f57a0067600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57c0158a30 0x7f57c01573e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57c00ce890 0x7f57c00b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 --2- 172.21.15.149:0/2890916525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57c00c4a20 0x7f57c009d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 >> 172.21.15.149:0/2890916525 conn(0x7f57c0098e30 msgr2=0x7f57c0067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:39.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 shutdown_connections 2024-08-17T02:50:39.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.381+0000 7f57bf200640 1 -- 172.21.15.149:0/2890916525 wait complete. 2024-08-17T02:50:39.397 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:50:39.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:39.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.546+0000 7f0e7d400640 1 Processor -- start 2024-08-17T02:50:39.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.546+0000 7f0e7d400640 1 -- start start 2024-08-17T02:50:39.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e7d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 0x7f0e780caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e7d400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0e78140580 0x7f0e780b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e7d400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e780b16d0 con 0x7f0e780b1270 2024-08-17T02:50:39.548 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e7d400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e780cb450 con 0x7f0e78140580 2024-08-17T02:50:39.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e7d400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780caa80 con 0x7f0e781401b0 2024-08-17T02:50:39.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e77200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0e780b1270 0x7f0e780c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60700/0 (socket says 172.21.15.149:60700) 2024-08-17T02:50:39.549 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e77200640 1 -- 172.21.15.149:0/1705199745 learned_addr learned my addr 172.21.15.149:0/1705199745 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-08-17T02:50:39.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e76800640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 0x7f0e780caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e6de00640 1 --2- 172.21.15.149:0/1705199745 >> v2:172.21.15.161:3300/0 conn(0x7f0e78140580 0x7f0e780b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135382125 0 0) 0x7f0e70001490 con 0x7f0e780b1270 2024-08-17T02:50:39.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.548+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5c0034e0 con 0x7f0e780b1270 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416133391 0 0) 0x7f0e5c0034e0 con 0x7f0e780b1270 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 msgr2=0x7f0e780caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 0x7f0e780caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 >> v2:172.21.15.161:3300/0 conn(0x7f0e78140580 msgr2=0x7f0e780b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 --2- 172.21.15.149:0/1705199745 >> v2:172.21.15.161:3300/0 conn(0x7f0e78140580 0x7f0e780b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780c9e70 con 0x7f0e780b1270 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3662971734 0 0) 0x7f0e70001980 con 0x7f0e780b1270 2024-08-17T02:50:39.552 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 >> v1:172.21.15.149:6789/0 conn(0x7f0e780b1270 legacy=0x7f0e780c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c0039d0 0x7f0e5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e5c004780 0x7f0e5c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 0x7f0e5c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780cb450 con 0x7f0e5c004780 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780caa80 con 0x7f0e5c0039d0 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c00b9d0 con 0x7f0e781401b0 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e6de00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e5c004780 0x7f0e5c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.553 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e76800640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c0039d0 0x7f0e5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.549+0000 7f0e77200640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 0x7f0e5c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.550+0000 7f0e6de00640 1 -- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 msgr2=0x7f0e5c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.550+0000 7f0e6de00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e781401b0 0x7f0e5c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.550+0000 7f0e6de00640 1 -- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c0039d0 msgr2=0x7f0e5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.550+0000 7f0e6de00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c0039d0 0x7f0e5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.550+0000 7f0e6de00640 1 -- 172.21.15.149:0/1705199745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c0034e0 con 0x7f0e5c004780 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e6de00640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e5c004780 0x7f0e5c004bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009ba0 tx=0x7f0e600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97788a7277b30383 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:39.554 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60031400 con 0x7f0e5c004780 2024-08-17T02:50:39.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e6002d050 con 0x7f0e5c004780 2024-08-17T02:50:39.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e75e00640 1 -- 172.21.15.149:0/1705199745 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600317b0 con 0x7f0e5c004780 2024-08-17T02:50:39.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e7d400640 1 -- 172.21.15.149:0/1705199745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e5c004780 msgr2=0x7f0e5c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e7d400640 1 --2- 172.21.15.149:0/1705199745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e5c004780 0x7f0e5c004bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009ba0 tx=0x7f0e600090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.557 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e77200640 1 -- 172.21.15.149:0/1705199745 reap_dead start 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e7d400640 1 -- 172.21.15.149:0/1705199745 shutdown_connections 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.551+0000 7f0e7d400640 1 -- 172.21.15.149:0/1705199745 >> 172.21.15.149:0/1705199745 conn(0x7f0e780cb9b0 msgr2=0x7f0e780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.552+0000 7f0e7d400640 1 -- 172.21.15.149:0/1705199745 shutdown_connections 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.552+0000 7f0e7d400640 1 -- 172.21.15.149:0/1705199745 wait complete. 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.553+0000 7f0e7d400640 1 Processor -- start 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.553+0000 7f0e7d400640 1 -- start start 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e7d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c004780 0x7f0e78160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.558 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e7d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e780a6170 0x7f0e7816cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e7d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 0x7f0e7816d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e7d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7813d350 con 0x7f0e7813be10 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e7d400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7813d630 con 0x7f0e5c004780 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e7d400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7813d910 con 0x7f0e780a6170 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e77200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 0x7f0e7816d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e77200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 0x7f0e7816d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36534/0 (socket says 172.21.15.149:36534) 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e77200640 1 -- 172.21.15.149:0/941405821 learned_addr learned my addr 172.21.15.149:0/941405821 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-08-17T02:50:39.559 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e77200640 1 -- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e780a6170 msgr2=0x7f0e7816cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e77200640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e780a6170 0x7f0e7816cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e77200640 1 -- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c004780 msgr2=0x7f0e78160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.554+0000 7f0e76800640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c004780 0x7f0e78160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e77200640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c004780 0x7f0e78160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e77200640 1 -- 172.21.15.149:0/941405821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7813dbf0 con 0x7f0e7813be10 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e77200640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 0x7f0e7816d4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0e7806aa80 tx=0x7f0e7000a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70007350 con 0x7f0e7813be10 2024-08-17T02:50:39.560 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e700074d0 con 0x7f0e7813be10 2024-08-17T02:50:39.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700078b0 con 0x7f0e7813be10 2024-08-17T02:50:39.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7813ded0 con 0x7f0e7813be10 2024-08-17T02:50:39.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.555+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7816da20 con 0x7f0e7813be10 2024-08-17T02:50:39.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.556+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7813e0c0 con 0x7f0e7813be10 2024-08-17T02:50:39.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.557+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e70013600 con 0x7f0e7813be10 2024-08-17T02:50:39.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.558+0000 7f0e6ea00640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e54065180 0x7f0e54067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:39.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.558+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0e70082150 con 0x7f0e7813be10 2024-08-17T02:50:39.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.558+0000 7f0e76800640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e54065180 0x7f0e54067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:39.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.559+0000 7f0e76800640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e54065180 0x7f0e54067630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009360 tx=0x7f0e68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:39.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.562+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e70050550 con 0x7f0e7813be10 2024-08-17T02:50:39.772 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.772+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e780b16d0 con 0x7f0e7813be10 2024-08-17T02:50:39.773 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.772+0000 7f0e6ea00640 1 -- 172.21.15.149:0/941405821 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f0e780b16d0 con 0x7f0e7813be10 2024-08-17T02:50:39.773 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-08-17T02:50:39.773 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3762094156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3762094156},{"type":"v1","addr":"172.21.15.161:6834","nonce":3762094156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1577637417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1577637417},{"type":"v1","addr":"172.21.15.149:6836","nonce":1577637417}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1907492324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":1907492324},{"type":"v1","addr":"172.21.15.161:6835","nonce":1907492324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5412,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4016530919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4016530919},{"type":"v1","addr":"172.21.15.149:6837","nonce":4016530919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2024-08-17T02:50:39.773 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2024-08-17T02:50:39.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e54065180 msgr2=0x7f0e54067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e54065180 0x7f0e54067630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009360 tx=0x7f0e68008040 comp rx=0 tx=0).stop 2024-08-17T02:50:39.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 msgr2=0x7f0e7816d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:39.775 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 0x7f0e7816d4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0e7806aa80 tx=0x7f0e7000a1a0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 shutdown_connections 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:6832/36958,v1:172.21.15.149:6833/36958] conn(0x7f0e54065180 0x7f0e54067630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e7813be10 0x7f0e7816d4e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e780a6170 0x7f0e7816cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 --2- 172.21.15.149:0/941405821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e5c004780 0x7f0e78160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 >> 172.21.15.149:0/941405821 conn(0x7f0e780cb9b0 msgr2=0x7f0e780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:39.776 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 shutdown_connections 2024-08-17T02:50:39.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-08-17T02:50:39.774+0000 7f0e7d400640 1 -- 172.21.15.149:0/941405821 wait complete. 2024-08-17T02:50:39.790 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:50:39.790 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:50:39.791 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:50:39.791 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:39.805 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:50:39.805 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:50:39.805 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:39.859 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:50:39.860 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:50:39.860 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:39.877 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:50:39.877 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:50:39.877 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:39.933 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:50:39.933 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:50:39.934 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:50:39.934 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:39.977 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:50:39.978 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:50:39.978 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.040 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:50:40.041 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:50:40.041 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.091 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:50:40.092 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:50:40.092 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.141 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:50:40.141 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:50:40.141 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.184 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:50:40.184 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:50:40.184 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.239 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:50:40.239 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:50:40.239 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:40.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:40.288 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:50:40.288 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:50:40.288 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.374 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:50:40.374 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:50:40.375 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:50:40.375 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.441 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:50:40.441 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:50:40.441 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.498 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:50:40.498 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:50:40.498 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:50:40.498 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.519 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:50:40.519 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:50:40.520 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.536 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:50:40.537 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:50:40.537 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:40.595 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:50:40.596 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:50:40.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:50:40.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:50:40.689 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:50:40.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:50:40.947 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:50:41.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:50:41.057 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:50:41.165 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:50:41.165 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:50:41.273 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:50:41.273 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:50:41.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:50:41.457 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:50:41.558 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:50:41.558 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:50:41.660 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:50:41.661 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:50:41.786 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:50:41.787 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/data/mon.a.tgz 2024-08-17T02:50:41.788 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-08-17T02:50:41.823 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.au8OA9rCeo 2024-08-17T02:50:41.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.au8OA9rCeo 2024-08-17T02:50:41.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.au8OA9rCeo 2024-08-17T02:50:42.084 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.au8OA9rCeo is 318KB 2024-08-17T02:50:42.173 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.au8OA9rCeo 2024-08-17T02:50:42.208 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/data/mon.b.tgz 2024-08-17T02:50:42.208 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-08-17T02:50:42.244 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.RweVeT8l84 2024-08-17T02:50:42.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RweVeT8l84 2024-08-17T02:50:42.442 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.RweVeT8l84 2024-08-17T02:50:42.536 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.RweVeT8l84 is 417KB 2024-08-17T02:50:42.627 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.RweVeT8l84 2024-08-17T02:50:42.662 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/data/mon.c.tgz 2024-08-17T02:50:42.662 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-08-17T02:50:42.736 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.wVYtFPmnbT 2024-08-17T02:50:42.737 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wVYtFPmnbT 2024-08-17T02:50:42.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.wVYtFPmnbT 2024-08-17T02:50:43.012 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.wVYtFPmnbT is 418KB 2024-08-17T02:50:43.101 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.wVYtFPmnbT 2024-08-17T02:50:43.135 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:50:43.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:50:43.139 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:50:43.230 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:50:43.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:50:43.235 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:50:43.293 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:50:43.296 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:50:43.307 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:50:43.308 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/remote/smithi149/crash 2024-08-17T02:50:43.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:50:43.364 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/remote/smithi161/crash 2024-08-17T02:50:43.365 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:50:43.420 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:50:43.421 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:43.425 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:43.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:43.593 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:43.648 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:50:43.649 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:50:43.653 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:50:43.703 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2024-08-17T02:50:43.704 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46894.log 2024-08-17T02:50:43.706 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-08-17T02:50:43.706 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2024-08-17T02:50:43.706 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-08-17T02:50:43.707 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46894.log.gz 2024-08-17T02:50:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:50:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43143.log 2024-08-17T02:50:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:50:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.3.43143.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:50:43.715 INFO:teuthology.orchestra.run.smithi161.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43143.log.gz 2024-08-17T02:50:43.715 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:50:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36993.log 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.b.log: 93.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.36993.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42822.log 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36993.log.gz 2024-08-17T02:50:43.716 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:50:43.717 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.42822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42822.log.gz 2024-08-17T02:50:43.717 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43542.log 2024-08-17T02:50:43.720 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41751.log 2024-08-17T02:50:43.720 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41751.log.gz 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42745.log 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-08-17T02:50:43.721 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47610.log 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42745.log.gz 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47610.log.gz 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49413.log 2024-08-17T02:50:43.722 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49413.log.gz 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37221.log 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2024-08-17T02:50:43.723 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42312.log 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37221.log.gz 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49707.log: gzip -5 87.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz /var/log/ceph/ceph.log 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42312.log.gz 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45221.log 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43070.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:50:43.724 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2024-08-17T02:50:43.725 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2024-08-17T02:50:43.725 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47484.log 2024-08-17T02:50:43.735 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45221.log.gz 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47484.log.gz 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2024-08-17T02:50:43.736 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46669.log 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45608.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50994.log 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46669.log.gz 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50994.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50994.log.gz 2024-08-17T02:50:43.737 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42142.log 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49455.log 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42142.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.42142.log.gz 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49455.log.gz 2024-08-17T02:50:43.738 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45347.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30888.log 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.tmp-client.admin.30888.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30888.log.gz 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49370.log 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-08-17T02:50:43.739 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49370.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:50:43.740 INFO:teuthology.orchestra.run.smithi149.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49370.log.gz 2024-08-17T02:50:43.740 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47440.log 2024-08-17T02:50:43.740 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2024-08-17T02:50:43.740 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36793.log 2024-08-17T02:50:43.740 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.43542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43542.log.gz 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36873.log 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.36793.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.36873.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36793.log.gz 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36873.log.gz 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36913.log 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:50:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.36913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2024-08-17T02:50:43.742 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36913.log.gz 2024-08-17T02:50:43.742 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-08-17T02:50:43.742 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.36742.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz/var/log/ceph/ceph-client.admin.36833.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:50:43.742 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-08-17T02:50:43.742 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-08-17T02:50:43.742 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-08-17T02:50:43.743 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:50:43.743 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36702.log 2024-08-17T02:50:43.743 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36953.log 2024-08-17T02:50:43.743 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.36953.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36702.log.gz 2024-08-17T02:50:43.743 INFO:teuthology.orchestra.run.smithi161.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36953.log.gz 2024-08-17T02:50:43.747 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48992.log 2024-08-17T02:50:43.747 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47440.log: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:50:43.747 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47440.log.gz 2024-08-17T02:50:43.747 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47270.log 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48992.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.37340.log 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48992.log.gz 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46627.log 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47270.log.gz 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37340.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.42480.log -- replaced with /var/log/ceph/ceph-client.admin.37340.log.gz 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42733.log 2024-08-17T02:50:43.748 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46627.log.gz 2024-08-17T02:50:43.749 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-08-17T02:50:43.749 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42480.log.gz 2024-08-17T02:50:43.749 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41670.log 2024-08-17T02:50:43.749 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42733.log.gz 2024-08-17T02:50:43.749 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47754.log: gzip -5 88.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz -- 2024-08-17T02:50:43.749 INFO:teuthology.orchestra.run.smithi149.stderr: /var/log/ceph/ceph-client.admin.46772.log 2024-08-17T02:50:43.750 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2024-08-17T02:50:43.750 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41670.log.gz 2024-08-17T02:50:43.750 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2024-08-17T02:50:43.750 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2024-08-17T02:50:43.750 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2024-08-17T02:50:43.751 INFO:teuthology.orchestra.run.smithi149.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2024-08-17T02:50:43.753 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51162.log 2024-08-17T02:50:43.753 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2024-08-17T02:50:43.753 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50448.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2024-08-17T02:50:43.753 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:50:43.753 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.51162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48484.log 2024-08-17T02:50:43.753 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51162.log.gz 2024-08-17T02:50:43.754 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42092.log 2024-08-17T02:50:43.754 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2024-08-17T02:50:43.754 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48484.log.gz 2024-08-17T02:50:43.754 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47568.log 2024-08-17T02:50:43.754 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42092.log.gz 2024-08-17T02:50:43.755 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50784.log 2024-08-17T02:50:43.756 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2024-08-17T02:50:43.756 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47568.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.47568.log.gz --verbose 2024-08-17T02:50:43.756 INFO:teuthology.orchestra.run.smithi149.stderr: -- /var/log/ceph/ceph-client.admin.50532.log 2024-08-17T02:50:43.756 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46073.log 2024-08-17T02:50:43.756 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50784.log.gz 2024-08-17T02:50:43.757 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49833.log 2024-08-17T02:50:43.757 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50532.log.gz 2024-08-17T02:50:43.757 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46073.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:50:43.757 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46073.log.gz 2024-08-17T02:50:43.758 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49833.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49833.log.gz 2024-08-17T02:50:43.758 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-08-17T02:50:43.759 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-08-17T02:50:43.760 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43418.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-08-17T02:50:43.760 INFO:teuthology.orchestra.run.smithi149.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:50:43.760 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2024-08-17T02:50:43.761 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47526.log 2024-08-17T02:50:43.761 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-08-17T02:50:43.762 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2024-08-17T02:50:43.762 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2024-08-17T02:50:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47526.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47526.log.gz 2024-08-17T02:50:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2024-08-17T02:50:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49978.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 2024-08-17T02:50:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45305.log 2024-08-17T02:50:43.765 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49286.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gzgzip 2024-08-17T02:50:43.765 INFO:teuthology.orchestra.run.smithi149.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51202.log 2024-08-17T02:50:43.766 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46543.log 2024-08-17T02:50:43.766 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45305.log.gz 2024-08-17T02:50:43.767 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.51202.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.51202.log.gz /var/log/ceph/ceph-osd.1.log 2024-08-17T02:50:43.767 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:50:43.768 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46543.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:50:43.768 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46543.log.gz 2024-08-17T02:50:43.768 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50574.log 2024-08-17T02:50:43.770 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47186.log 2024-08-17T02:50:43.771 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-08-17T02:50:43.771 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50574.log.gz 2024-08-17T02:50:43.772 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43992.log 2024-08-17T02:50:43.772 INFO:teuthology.orchestra.run.smithi161.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:50:43.773 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47186.log.gz 2024-08-17T02:50:43.773 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2024-08-17T02:50:43.773 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-08-17T02:50:43.774 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43992.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:50:43.775 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43992.log.gz 2024-08-17T02:50:43.776 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43402.log 2024-08-17T02:50:43.776 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2024-08-17T02:50:43.778 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46729.log 2024-08-17T02:50:43.778 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49244.log 2024-08-17T02:50:43.778 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43402.log.gz 2024-08-17T02:50:43.779 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46729.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2024-08-17T02:50:43.781 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49244.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49244.log.gz 2024-08-17T02:50:43.782 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44712.log 2024-08-17T02:50:43.783 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46031.log 2024-08-17T02:50:43.783 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.44712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44712.log.gz 2024-08-17T02:50:43.784 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2024-08-17T02:50:43.785 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45559.log 2024-08-17T02:50:43.785 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46031.log.gz 2024-08-17T02:50:43.787 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46585.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2024-08-17T02:50:43.788 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45559.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42226.log 2024-08-17T02:50:43.789 INFO:teuthology.orchestra.run.smithi149.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2024-08-17T02:50:43.789 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48526.log 2024-08-17T02:50:43.790 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49791.log 2024-08-17T02:50:43.791 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42226.log.gz 2024-08-17T02:50:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48526.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48526.log.gz 2024-08-17T02:50:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50700.log 2024-08-17T02:50:43.793 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49791.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49791.log.gz 2024-08-17T02:50:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45779.log 2024-08-17T02:50:43.795 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42744.log 2024-08-17T02:50:43.795 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50700.log.gz 2024-08-17T02:50:43.797 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45779.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45779.log.gz 2024-08-17T02:50:43.797 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5/var/log/ceph/ceph-client.admin.42744.log: --verbose -- /var/log/ceph/ceph-client.admin.49539.log 2024-08-17T02:50:43.798 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42744.log.gz 2024-08-17T02:50:43.798 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50952.log 2024-08-17T02:50:43.799 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48612.log 2024-08-17T02:50:43.800 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49539.log.gz 2024-08-17T02:50:43.801 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45263.log 2024-08-17T02:50:43.801 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50952.log.gz 2024-08-17T02:50:43.802 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2024-08-17T02:50:43.802 INFO:teuthology.orchestra.run.smithi149.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.48612.log.gz 2024-08-17T02:50:43.803 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43066.log 2024-08-17T02:50:43.803 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45263.log.gz 2024-08-17T02:50:43.805 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42736.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2024-08-17T02:50:43.805 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43066.log: /var/log/ceph/ceph-client.admin.45431.log 2024-08-17T02:50:43.806 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43066.log.gz 2024-08-17T02:50:43.806 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42741.log 2024-08-17T02:50:43.808 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48304.log 2024-08-17T02:50:43.808 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2024-08-17T02:50:43.809 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-08-17T02:50:43.809 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42741.log.gz 2024-08-17T02:50:43.810 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2024-08-17T02:50:43.810 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48304.log.gz 2024-08-17T02:50:43.813 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47796.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-08-17T02:50:43.813 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-08-17T02:50:43.813 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-08-17T02:50:43.814 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50020.log 2024-08-17T02:50:43.815 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2024-08-17T02:50:43.816 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-08-17T02:50:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50020.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50020.log.gz 2024-08-17T02:50:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:50:43.818 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44076.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2024-08-17T02:50:43.819 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-08-17T02:50:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-08-17T02:50:43.822 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47922.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-08-17T02:50:43.822 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49202.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-08-17T02:50:43.823 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51078.log 2024-08-17T02:50:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43081.log 2024-08-17T02:50:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.51078.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51078.log.gz 2024-08-17T02:50:43.826 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2024-08-17T02:50:43.827 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43081.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43081.log.gz 2024-08-17T02:50:43.828 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43425.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2024-08-17T02:50:43.829 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-08-17T02:50:43.831 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41464.log 2024-08-17T02:50:43.832 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46291.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-08-17T02:50:43.833 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41464.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41464.log.gz 2024-08-17T02:50:43.833 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2024-08-17T02:50:43.835 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2024-08-17T02:50:43.836 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44244.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:50:43.836 INFO:teuthology.orchestra.run.smithi149.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2024-08-17T02:50:43.837 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49749.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2024-08-17T02:50:43.838 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2024-08-17T02:50:43.839 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44034.log 2024-08-17T02:50:43.841 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2024-08-17T02:50:43.841 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2024-08-17T02:50:43.842 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44034.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44034.log.gz 2024-08-17T02:50:43.842 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42746.log 2024-08-17T02:50:43.843 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47312.log 2024-08-17T02:50:43.844 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2024-08-17T02:50:43.845 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51120.log 2024-08-17T02:50:43.845 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42746.log.gz 2024-08-17T02:50:43.846 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51036.log 2024-08-17T02:50:43.846 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47312.log.gz 2024-08-17T02:50:43.847 INFO:teuthology.orchestra.run.smithi161.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:50:43.848 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.51120.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51120.log.gz 2024-08-17T02:50:43.848 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.51036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-08-17T02:50:43.848 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51036.log.gz 2024-08-17T02:50:43.849 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42354.log 2024-08-17T02:50:43.850 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43400.log 2024-08-17T02:50:43.851 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2024-08-17T02:50:43.852 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42354.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42354.log.gz 2024-08-17T02:50:43.853 INFO:teuthology.orchestra.run.smithi149.stderr:gzip/var/log/ceph/ceph-client.admin.43400.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49160.log 2024-08-17T02:50:43.853 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43400.log.gz 2024-08-17T02:50:43.853 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50658.log 2024-08-17T02:50:43.855 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2024-08-17T02:50:43.855 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49160.log.gz 2024-08-17T02:50:43.856 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50658.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50658.log.gz 2024-08-17T02:50:43.857 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49118.log 2024-08-17T02:50:43.857 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50616.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2024-08-17T02:50:43.858 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43079.log 2024-08-17T02:50:43.859 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48568.log 2024-08-17T02:50:43.859 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49118.log.gz 2024-08-17T02:50:43.861 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43079.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43079.log.gz 2024-08-17T02:50:43.861 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48262.log 2024-08-17T02:50:43.862 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51244.log 2024-08-17T02:50:43.863 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48568.log.gz 2024-08-17T02:50:43.864 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48217.log 2024-08-17T02:50:43.864 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48262.log.gz 2024-08-17T02:50:43.865 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.51244.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51244.log.gz 2024-08-17T02:50:43.865 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47059.log 2024-08-17T02:50:43.866 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.48217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48217.log.gz 2024-08-17T02:50:43.866 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2024-08-17T02:50:43.867 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-08-17T02:50:43.868 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47059.log.gz 2024-08-17T02:50:43.869 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49936.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2024-08-17T02:50:43.870 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48824.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-08-17T02:50:43.871 INFO:teuthology.orchestra.run.smithi161.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:50:43.871 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49623.log 2024-08-17T02:50:43.872 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42522.log 2024-08-17T02:50:43.873 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2024-08-17T02:50:43.873 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49623.log.gz 2024-08-17T02:50:43.874 INFO:teuthology.orchestra.run.smithi161.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:50:43.875 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42522.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42522.log.gz 2024-08-17T02:50:43.875 INFO:teuthology.orchestra.run.smithi149.stderr: /var/log/ceph/ceph-client.admin.48950.log 2024-08-17T02:50:43.876 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45119.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz /var/log/ceph/ceph-client.admin.43740.log 2024-08-17T02:50:43.876 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:50:43.877 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46501.log 2024-08-17T02:50:43.877 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48950.log.gz 2024-08-17T02:50:43.879 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 2024-08-17T02:50:43.879 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2024-08-17T02:50:43.880 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46501.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46501.log.gz 2024-08-17T02:50:43.880 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45516.log 2024-08-17T02:50:43.881 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43824.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2024-08-17T02:50:43.881 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2024-08-17T02:50:43.883 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2024-08-17T02:50:43.883 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45516.log.gz 2024-08-17T02:50:43.884 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47838.log 2024-08-17T02:50:43.884 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2024-08-17T02:50:43.885 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43406.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2024-08-17T02:50:43.886 INFO:teuthology.orchestra.run.smithi149.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz 2024-08-17T02:50:43.887 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-08-17T02:50:43.887 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gz 2024-08-17T02:50:43.889 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48866.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2024-08-17T02:50:43.889 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50280.log 2024-08-17T02:50:43.889 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43698.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-08-17T02:50:43.890 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-08-17T02:50:43.890 INFO:teuthology.orchestra.run.smithi149.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:50:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-08-17T02:50:43.895 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50280.log.gz 2024-08-17T02:50:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47102.log 2024-08-17T02:50:43.895 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-08-17T02:50:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43393.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-08-17T02:50:43.896 INFO:teuthology.orchestra.run.smithi149.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49497.log 2024-08-17T02:50:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2024-08-17T02:50:43.897 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47102.log.gz 2024-08-17T02:50:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49497.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49497.log.gz 2024-08-17T02:50:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49581.log 2024-08-17T02:50:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-08-17T02:50:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50238.log: /var/log/ceph/ceph-client.admin.49581.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2024-08-17T02:50:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50742.log 2024-08-17T02:50:43.898 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49581.log.gz 2024-08-17T02:50:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47228.log 2024-08-17T02:50:43.899 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-08-17T02:50:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50742.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50742.log.gz 2024-08-17T02:50:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2024-08-17T02:50:43.901 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2024-08-17T02:50:43.901 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47228.log.gz 2024-08-17T02:50:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2024-08-17T02:50:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2024-08-17T02:50:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45075.log 2024-08-17T02:50:43.903 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gz 2024-08-17T02:50:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46814.log 2024-08-17T02:50:43.904 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-08-17T02:50:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.2.45075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45075.log.gz 2024-08-17T02:50:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-08-17T02:50:43.906 INFO:teuthology.orchestra.run.smithi161.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:50:43.907 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-08-17T02:50:43.907 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46814.log.gz 2024-08-17T02:50:43.908 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41836.log 2024-08-17T02:50:43.908 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-08-17T02:50:43.909 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45389.log 2024-08-17T02:50:43.910 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-08-17T02:50:43.910 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48388.log 2024-08-17T02:50:43.910 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41836.log.gz 2024-08-17T02:50:43.911 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49034.log 2024-08-17T02:50:43.912 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45389.log.gz 2024-08-17T02:50:43.912 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46333.log 2024-08-17T02:50:43.913 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48388.log.gz 2024-08-17T02:50:43.913 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50868.log 2024-08-17T02:50:43.914 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49034.log.gz 2024-08-17T02:50:43.915 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-08-17T02:50:43.915 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46333.log.gz 2024-08-17T02:50:43.916 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46417.log 2024-08-17T02:50:43.916 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50868.log.gz 2024-08-17T02:50:43.917 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50826.log 2024-08-17T02:50:43.917 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-08-17T02:50:43.918 INFO:teuthology.orchestra.run.smithi161.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:50:43.919 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46417.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46417.log.gz 2024-08-17T02:50:43.919 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49076.log 2024-08-17T02:50:43.919 INFO:teuthology.orchestra.run.smithi149.stderr:gzip/var/log/ceph/ceph-client.admin.50826.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49893.log 2024-08-17T02:50:43.920 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50826.log.gz 2024-08-17T02:50:43.920 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49076.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49076.log.gz 2024-08-17T02:50:43.921 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42396.log 2024-08-17T02:50:43.921 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-08-17T02:50:43.922 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49893.log.gz 2024-08-17T02:50:43.923 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42396.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42396.log.gz 2024-08-17T02:50:43.923 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44160.log 2024-08-17T02:50:43.924 INFO:teuthology.orchestra.run.smithi149.stderr:gzip/var/log/ceph/ceph-client.admin.43908.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47396.log 2024-08-17T02:50:43.924 INFO:teuthology.orchestra.run.smithi161.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:50:43.925 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-08-17T02:50:43.925 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.44160.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44160.log.gz 2024-08-17T02:50:43.925 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-08-17T02:50:43.926 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:50:43.927 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-08-17T02:50:43.927 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m0.241s 2024-08-17T02:50:43.927 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m1.010s 2024-08-17T02:50:43.927 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.167s 2024-08-17T02:50:43.928 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47396.log: 87.7%/var/log/ceph/ceph-client.admin.42740.log: -- replaced with /var/log/ceph/ceph-client.admin.47396.log.gz 2024-08-17T02:50:43.928 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-08-17T02:50:43.928 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-08-17T02:50:43.928 INFO:teuthology.orchestra.run.smithi149.stderr:gzip/var/log/ceph/ceph-mds.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43069.log 2024-08-17T02:50:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47712.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-08-17T02:50:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50910.log 2024-08-17T02:50:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2024-08-17T02:50:43.931 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2024-08-17T02:50:43.931 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 2024-08-17T02:50:43.932 INFO:teuthology.orchestra.run.smithi149.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50910.log.gz 2024-08-17T02:50:43.933 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-08-17T02:50:43.933 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2024-08-17T02:50:43.934 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43082.log 2024-08-17T02:50:43.934 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2024-08-17T02:50:43.935 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47880.log: gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-08-17T02:50:43.936 INFO:teuthology.orchestra.run.smithi149.stderr: /var/log/ceph/ceph-client.admin.45695.log 2024-08-17T02:50:43.936 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43082.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43082.log.gz 2024-08-17T02:50:43.937 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47354.log 2024-08-17T02:50:43.938 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47144.log 2024-08-17T02:50:43.938 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45695.log.gz 2024-08-17T02:50:43.939 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2024-08-17T02:50:43.940 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47354.log.gz 2024-08-17T02:50:43.941 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47144.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47144.log.gz 2024-08-17T02:50:43.941 INFO:teuthology.orchestra.run.smithi149.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42438.log 2024-08-17T02:50:43.942 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.45179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48346.log 2024-08-17T02:50:43.942 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz 2024-08-17T02:50:43.943 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-08-17T02:50:43.943 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42438.log.gz 2024-08-17T02:50:43.944 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48346.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48346.log.gz 2024-08-17T02:50:43.945 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48030.log 2024-08-17T02:50:43.946 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41574.log 2024-08-17T02:50:43.946 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-08-17T02:50:43.947 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.48030.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48030.log.gz 2024-08-17T02:50:43.947 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50406.log 2024-08-17T02:50:43.948 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41878.log 2024-08-17T02:50:43.949 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41574.log.gz 2024-08-17T02:50:43.950 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.50406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50406.log.gz 2024-08-17T02:50:43.950 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:50:43.951 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.41878.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41878.log.gz 2024-08-17T02:50:43.951 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2024-08-17T02:50:43.952 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46249.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-08-17T02:50:43.953 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-08-17T02:50:43.954 INFO:teuthology.orchestra.run.smithi149.stderr:gzip/var/log/ceph/ceph-client.admin.43382.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49328.log 2024-08-17T02:50:43.954 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2024-08-17T02:50:43.955 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2024-08-17T02:50:43.955 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-08-17T02:50:43.956 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.49328.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49328.log.gz 2024-08-17T02:50:43.956 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-08-17T02:50:43.957 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.46975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-08-17T02:50:43.958 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2024-08-17T02:50:43.959 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.43298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42048.log 2024-08-17T02:50:43.959 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2024-08-17T02:50:43.960 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.47964.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-08-17T02:50:43.961 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.42048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42048.log.gz 2024-08-17T02:50:43.966 INFO:teuthology.orchestra.run.smithi149.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:50:43.972 INFO:teuthology.orchestra.run.smithi149.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:50:43.990 INFO:teuthology.orchestra.run.smithi149.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:50:44.005 INFO:teuthology.orchestra.run.smithi149.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:50:44.095 INFO:teuthology.orchestra.run.smithi149.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:50:44.098 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-08-17T02:50:44.098 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m0.417s 2024-08-17T02:50:44.098 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m1.193s 2024-08-17T02:50:44.098 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.635s 2024-08-17T02:50:44.100 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:50:44.100 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/remote/smithi149/log 2024-08-17T02:50:44.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:50:44.452 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/remote/smithi161/log 2024-08-17T02:50:44.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:50:44.636 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:50:44.659 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:50:44.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:50:44.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:50:44.768 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:50:44.777 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:50:44.778 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:50:44.782 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:50:44.811 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:50:44.815 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:50:44.818 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:50:44.818 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-08-17T02:50:44.818 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -11us[-2747ns] +/- 46ms 2024-08-17T02:50:44.818 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -50us[ -41us] +/- 80ms 2024-08-17T02:50:44.819 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +83us[ +91us] +/- 65ms 2024-08-17T02:50:44.819 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:50:44.822 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:50:44.823 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-08-17T02:50:44.823 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +3911ns[ +22us] +/- 46ms 2024-08-17T02:50:44.823 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -19us[ -19us] +/- 80ms 2024-08-17T02:50:44.823 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +101us[ +119us] +/- 65ms 2024-08-17T02:50:44.823 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:50:44.824 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:50:44.833 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:50:44.833 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:50:44.882 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:50:45.000 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:50:45.112 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:50:45.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:45.173 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:50:45.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:45.234 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:50:45.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:50:45.252 INFO:teuthology.task.internal:Duration was 750.674743 seconds 2024-08-17T02:50:45.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:50:45.260 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:50:45.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:50:45.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:50:45.348 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:50:45.352 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:50:45.804 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:50:45.805 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-08-17T02:50:45.805 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:50:45.854 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-08-17T02:50:45.855 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:50:45.903 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:50:45.904 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:50:45.908 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:50:45.966 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:50:45.967 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:50:45.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:50:46.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:50:46.122 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:50:46.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:50:46.178 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:50:46.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:50:46.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:46.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:46.315 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-08-17T02:50:46.320 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-08-17T02:50:46.350 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:46.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:46.384 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:46.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:46.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:50:46.428 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:50:46.429 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/remote/smithi149 2024-08-17T02:50:46.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:50:46.494 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858294/remote/smithi161 2024-08-17T02:50:46.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:50:46.559 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:50:46.559 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:50:46.563 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:50:46.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:50:46.611 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:50:46.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:50:46.640 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:50:46.641 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:50:46.645 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:50:46.676 INFO:teuthology.orchestra.run.smithi149.stdout: 393545 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:50 /home/ubuntu/cephtest 2024-08-17T02:50:46.679 INFO:teuthology.orchestra.run.smithi161.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:50 /home/ubuntu/cephtest 2024-08-17T02:50:46.682 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:50:46.692 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:50:46.715 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 750.6747434139252 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0e12c1b2d0e74befbea2be0b093b6ecf status: fail success: false 2024-08-17T02:50:46.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:50:46.790 INFO:teuthology.run:FAIL